-- Logs begin at Mon 2022-08-01 13:17:21 UTC, end at Mon 2022-08-01 14:40:39 UTC. -- Aug 01 14:11:13.093678 dv-cinder-787296-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 14:11:13.104571 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 14:11:13.107107 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 14:11:13 2022] *** Aug 01 14:11:13.107107 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 14:11:13.107107 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 14:11:13.107107 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: nodename: dv-cinder-787296-13-iscsi Aug 01 14:11:13.107107 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: machine: x86_64 Aug 01 14:11:13.107107 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: clock source: unix Aug 01 14:11:13.107107 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: pcre jit disabled Aug 01 14:11:13.107107 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: detected number of CPU cores: 4 Aug 01 14:11:13.107107 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: current working directory: / Aug 01 14:11:13.107107 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: detected binary path: /usr/bin/uwsgi-core Aug 01 14:11:13.107872 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: your processes number limit is 47680 Aug 01 14:11:13.107872 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: your memory page size is 4096 bytes Aug 01 14:11:13.107872 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: detected max file descriptor number: 2048 Aug 01 14:11:13.107872 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: lock engine: pthread robust mutexes Aug 01 14:11:13.107872 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: thunder lock: enabled Aug 01 14:11:13.107872 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 14:11:13.107872 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 14:11:13.147841 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: Python main interpreter initialized at 0x55a7aa6e39c0 Aug 01 14:11:13.147841 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: python threads support enabled Aug 01 14:11:13.147841 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: your server socket listen backlog is limited to 100 connections Aug 01 14:11:13.147841 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: your mercy for graceful operations on workers is 90 seconds Aug 01 14:11:13.148254 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 14:11:13.148254 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: *** Operational MODE: preforking *** Aug 01 14:11:13.148522 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: *** uWSGI is running in multiple interpreter mode *** Aug 01 14:11:13.148522 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: spawned uWSGI master process (pid: 103715) Aug 01 14:11:13.148755 dv-cinder-787296-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 14:11:13.149912 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: spawned uWSGI worker 1 (pid: 103716, cores: 1) Aug 01 14:11:13.149912 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: spawned uWSGI worker 2 (pid: 103717, cores: 1) Aug 01 14:11:13.149912 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 14:11:13.849194 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 14:11:13.855934 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 14:11:14.952432 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:11:14.952432 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: from cryptography.utils import int_from_bytes Aug 01 14:11:14.953110 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:11:14.953110 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: from cryptography.utils import int_from_bytes Aug 01 14:11:14.959255 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:11:14.959255 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: from cryptography.utils import int_from_bytes Aug 01 14:11:14.959721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:11:14.959721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: from cryptography.utils import int_from_bytes Aug 01 14:11:17.452008 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:11:17.452620 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:11:17.452620 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:11:17.453240 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:11:17.453370 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:11:17.453512 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:11:17.453649 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:11:17.453839 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:11:17.453964 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:11:17.454093 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:11:17.454226 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.454347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.454484 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.454624 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.454744 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.454866 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.455001 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.455134 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.455268 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.455398 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.455524 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.456439 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.456572 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.456724 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.456855 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.456980 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.456980 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.457259 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.457397 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.457540 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.457540 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.457803 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.457926 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-13-iscsi {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.458055 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-13-iscsi {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.458237 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.458374 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.458492 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.458675 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.458813 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.458942 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.459072 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.459206 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.459335 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.459455 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.459584 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.459717 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.459850 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.459969 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.460206 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.460355 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.460637 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.460822 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.460989 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.461159 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.461319 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.461480 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.461657 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.461871 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.462056 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.462222 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.462388 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.462593 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.462768 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.462913 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.463101 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.463249 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.463385 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.463515 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.463699 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.463820 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.463963 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-13-iscsi {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.464101 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-13-iscsi {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.464230 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.464370 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.464497 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.464628 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.464628 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.464885 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.465164 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.465414 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.465602 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.465804 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.465996 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.466122 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.466297 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.466416 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.466416 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.466708 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.466887 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.467009 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.467191 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.467357 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.467488 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.467655 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.467780 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.467911 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.468031 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.468174 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.468318 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.468436 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.468576 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.468694 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.468870 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.469002 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.469122 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.469293 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.469421 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.469540 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.469660 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.469821 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.469943 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.470062 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.470212 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.470333 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.470531 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.470682 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.470849 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.470971 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.471168 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.471293 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.472022 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.472277 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.472483 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.472669 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.472898 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.473082 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.473203 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.473383 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.473534 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.473654 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.473815 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.473956 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.474077 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.474198 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.474318 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.474437 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.474565 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.474695 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.474821 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.474940 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.475058 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.475250 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.475382 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.475557 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.475690 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.475865 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.475985 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.476182 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.476314 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.476483 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.476603 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.476797 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.476925 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.477119 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.477264 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.477422 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.477551 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.477732 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.477939 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.478060 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.478193 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.478392 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.478518 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.478697 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.478817 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.479010 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.479140 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.479312 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.479435 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.479616 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.479737 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.479924 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.480050 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.480229 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.480351 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.480537 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.480656 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.480859 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.480992 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.481160 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.481289 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.481409 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.481530 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.481697 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.481866 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.482031 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.482153 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.482347 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.482480 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.482654 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.482775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.482959 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.483080 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.483266 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.483407 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.483591 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.483720 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.483842 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.483960 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.484144 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.484281 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.484449 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.484572 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.484752 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.484873 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.485056 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.485187 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.485355 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.485485 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.485659 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.485814 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.485988 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.486129 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.486306 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.486426 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.486587 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.486709 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.486901 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.487076 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.487302 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.487449 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.487693 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.487825 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.488000 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.488122 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.488305 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.488436 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.488613 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.488743 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.488915 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.489051 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.489220 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.489356 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.489529 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.489659 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.489853 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.489977 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.490157 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.490280 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.490471 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.490593 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.490803 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.490924 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.491092 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.491221 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.491367 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.491489 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.491665 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.491785 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.491969 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.492092 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.492276 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.492397 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.492578 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.492700 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.492881 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.493002 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.493192 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.493333 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.493487 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.493611 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.493824 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.493944 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.494103 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.494238 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.494404 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.494526 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.494706 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.494827 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.495002 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.495133 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.495302 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.495431 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.495626 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.495767 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.495944 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.496134 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.496266 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.496455 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.496637 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.496761 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.496895 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.497028 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.497149 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.497269 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:11:17.497444 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.497588 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.497804 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.497945 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.498117 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.498284 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.498448 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.498587 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.498773 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.498907 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.499093 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.499277 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.499399 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.499533 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.499702 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.499847 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.500026 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.500152 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.500338 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.500479 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.500649 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.500772 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.500960 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.501092 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.501278 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.501413 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.501596 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.502017 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.502209 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.502348 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.502524 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.503203 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.503376 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.503610 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.503752 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.503940 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.504213 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.504356 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.504478 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.504608 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.504804 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.504937 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.505124 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.505256 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.505435 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.505559 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.505792 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.505921 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.506137 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.506274 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.506451 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.506576 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.506783 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.506934 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.507102 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.507223 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.507409 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.507530 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.507717 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.507838 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.508024 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.508157 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.508333 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.508453 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.508657 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.508784 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.508965 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.509086 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.509292 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.509467 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.509623 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.509850 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.509990 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.510112 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.510233 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.510355 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.510508 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.510645 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.510806 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.510928 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.511137 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.511260 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.511452 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.511583 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.511764 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.511888 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.512071 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.512193 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.512384 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.512515 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.512691 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.512813 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.512998 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.513121 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.513307 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.513440 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.513609 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.513732 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.513942 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.514087 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.514224 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.514456 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.514584 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.514759 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.514881 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.515026 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.515159 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.515340 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.515462 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.515669 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.515801 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.516000 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.516135 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.516312 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.516435 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.516649 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.516781 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.516962 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.517106 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.517275 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.517397 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.517588 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.517711 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.517930 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.518068 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.518874 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.519025 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.519154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.519284 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.519441 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.519568 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.519701 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.519919 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.520051 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.520187 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.520332 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.520480 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.520603 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.520786 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.520909 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.521089 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.521229 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.521402 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.521524 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.521712 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.521880 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.522050 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.522195 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.522363 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.522511 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.522673 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.522818 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.522992 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.523128 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.523308 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.523450 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.523600 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.523729 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.523938 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.524082 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.524265 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.524404 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.524557 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.524695 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.524905 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.525046 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.525264 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.525398 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.525541 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.525684 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.525876 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.526022 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.526161 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.526299 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.526442 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.526583 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.526711 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.526841 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.526970 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.527137 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.527278 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.527447 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.527582 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.527763 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.527906 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.528059 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.528191 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.528364 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.528499 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.528672 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.528808 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.529003 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.529156 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.529304 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.529435 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.529578 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.529714 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.529868 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.530005 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.530167 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.530304 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.530500 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.530645 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.530789 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.530940 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.531127 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.531274 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.531416 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.531546 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.531761 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.531912 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.532056 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.532196 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.532374 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.532510 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.532686 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.532839 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.532987 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.533133 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.533275 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.533408 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.533584 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.533731 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.533976 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.534115 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.534444 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.534755 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.534927 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.535054 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.535364 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.535519 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.535665 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.535809 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.535971 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.536118 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.536259 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.536398 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.536566 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.536710 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.536864 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.537070 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.537198 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.537407 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.537556 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.537745 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.537975 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.538112 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.538231 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.538413 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.538545 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.538733 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.538870 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.539042 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.539172 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.539347 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.539490 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.539658 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.539789 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.539985 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.540119 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.540258 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.540384 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.540560 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.540691 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.540875 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.541011 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.541181 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.541305 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.541499 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.541640 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.541828 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.541966 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.542144 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.542294 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.542447 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.542577 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.542754 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.542891 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.543080 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.543217 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.543406 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.543547 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.543718 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.543863 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.544029 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.544256 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.544378 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.544511 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.544629 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.544744 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.544938 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.545110 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.545246 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.545366 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.545523 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.545664 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.545863 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.546103 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.546251 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.546431 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.546554 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.546754 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.546899 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.547073 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.547192 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.547379 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.547505 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.547691 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.547819 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.547996 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.548118 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.548298 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.548420 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.548601 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.548740 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.548910 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.549039 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.549226 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.549344 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.549635 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.549804 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.549964 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.550102 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.550282 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.550550 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.550690 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.550862 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.550999 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.551167 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.551288 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.551487 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.551620 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.551799 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.551929 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.552104 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.552226 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.552408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.552540 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.552713 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.552885 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.553054 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.553190 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.553365 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.553495 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.553668 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.553830 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.554001 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.554121 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.554314 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.554437 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.554620 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.554752 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.554936 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.555059 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.555238 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.555378 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.555542 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.555673 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.555859 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.555985 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.556172 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.556306 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.556479 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.556617 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.556788 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.556911 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.557098 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.557234 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.557425 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.557548 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.557703 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.557894 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.558025 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.558151 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.558341 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.558478 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.558649 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.558781 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.558959 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.559080 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.559260 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.559393 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.559572 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.559714 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.559884 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.560006 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.560203 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.560462 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.560599 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.560801 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.560924 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.561114 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.561248 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.561434 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.561571 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.561812 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.562036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.562159 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.562377 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.562509 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.562701 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.562826 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.563026 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.563159 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.563351 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.563485 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.563661 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.563812 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.563970 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.564093 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.564275 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.564409 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.564582 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.564724 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.564891 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.565024 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.565862 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.566023 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.566172 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.566330 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.566491 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.566625 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.566742 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.566854 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.566965 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.567111 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.567258 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.567417 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.567570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.567716 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.567887 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.568008 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.568199 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.568320 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.568506 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.568626 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.568815 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.569058 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.569194 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.569393 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.569520 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.569638 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.569833 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.569982 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.570103 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.570285 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.570409 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.570553 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.570676 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.570815 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.570943 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.571065 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.571258 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.571393 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.571566 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.571699 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.571878 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.572009 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.572222 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.572344 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.572535 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.572660 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.572857 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.572984 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.573155 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.573378 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.573519 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.573641 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.573796 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.573919 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.574076 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.574257 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.574407 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.574593 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.574728 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.574910 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.575033 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.575221 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.575345 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.575534 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.575667 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.575830 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.575959 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.576139 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.576269 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.576443 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.576564 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.576744 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.576867 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.577055 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.577178 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.577359 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.577481 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.577653 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.577791 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.577989 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.578126 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.578304 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.578437 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.578613 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.578745 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.578912 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.579048 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.579219 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.579342 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.579519 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.579663 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.579823 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.579946 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.580116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.580248 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.580409 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.580545 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.581554 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.581717 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.581920 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.582066 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.582199 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.582333 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.582333 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.582575 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.582693 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.582807 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.582922 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.583060 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.583216 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.583338 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.583515 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.583637 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.583823 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.583950 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.584125 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.584246 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.584425 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.584546 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.584735 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.584871 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.585057 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.585189 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.585369 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.585493 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.585662 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.585807 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.585995 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.586133 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.586298 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.586419 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.586603 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.586725 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.586905 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.587035 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.587319 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.587467 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.587781 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.587904 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.588031 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.588199 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.588324 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.588508 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.588634 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.588815 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.588937 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.589121 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.589253 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.589444 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.589568 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.589804 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.589944 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.590078 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.590195 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.590378 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.590506 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.590684 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.590816 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.591026 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.591228 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.591376 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.591507 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.591676 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.591808 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.591982 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.592119 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.592291 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.592421 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.592607 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.592731 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.592916 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.593054 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.593225 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.593357 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.593536 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.593667 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.593862 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.594013 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.594180 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.594302 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.594491 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.594618 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.594799 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.594923 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.595111 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.595243 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.595409 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.595541 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.595728 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.596054 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.596177 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.596301 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.596301 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.596626 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.596788 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.596968 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.597127 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.597290 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.597406 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.597601 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.597742 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.597937 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.598052 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.598229 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.598370 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.598604 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.598726 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.598852 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.598979 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.599107 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.599235 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.599422 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.599547 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.599732 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.599854 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.600042 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.600163 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.600352 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.600476 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.600665 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.600790 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.600974 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.601095 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.601278 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.601401 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.601584 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.601706 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.601916 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.602181 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.602306 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.602527 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.602664 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.602835 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.602962 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.603136 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.603269 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.603443 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.603565 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.603746 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.603866 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.604053 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.604186 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.604353 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.604473 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.604764 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.604888 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.605081 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.605203 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.605392 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.605514 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.605699 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.605869 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.606077 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.606201 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.606385 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.606547 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.606702 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.607016 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.607187 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.607310 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.607498 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.607716 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.607852 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.608028 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.608157 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.608338 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.608466 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.608647 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.608781 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.608948 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.609072 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.609250 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.609430 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.609563 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.609742 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.609934 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.610115 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.610601 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.610732 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.610869 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.610993 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.611111 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.611222 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.611338 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.611473 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.611603 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.611721 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.611836 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.612255 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.612385 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.612514 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.612662 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.612662 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.612911 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.613028 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.613145 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.613343 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.613471 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.613652 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.613842 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.613991 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.614120 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.614304 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.614441 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.614625 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.614748 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.614934 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.615128 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.615262 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.615447 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.615575 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.615767 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.615905 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.616107 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.616209 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.616426 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.616532 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.616750 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.616838 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.617059 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.617165 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.617477 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.617699 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.617809 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.618138 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.618238 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.618467 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.618563 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.618787 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.618874 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.619109 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.619198 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.619466 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.619568 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.619796 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.619892 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.620121 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.620207 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.620439 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.620534 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.620747 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.620881 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.621048 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.621262 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.621360 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.621595 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.621684 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.621939 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.622051 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.622269 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.622385 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.622570 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.622667 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.622884 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.622983 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.623191 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.623290 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.623496 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.623583 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.623803 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.623900 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.624113 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.624210 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.624450 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.624609 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.624758 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.624885 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.625065 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.625225 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.625377 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.625464 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.625693 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.625806 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.626030 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.626129 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.626338 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.626437 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.626653 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.627003 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.627225 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.627314 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.627527 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.628157 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.628358 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.628479 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.628660 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.628828 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.629001 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.629245 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.629333 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.629562 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.629658 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.629919 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.630014 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.630239 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.630326 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.630553 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.630642 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.630864 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.630960 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.631174 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.631262 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.631497 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.631584 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.631814 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.631911 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.632134 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.632439 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.632534 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.632741 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.632828 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.633048 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.633152 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.633350 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.633448 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.633654 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.633768 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.633991 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.634113 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.634446 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.634620 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.634781 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.634938 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.635110 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.635251 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.635424 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.635565 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.635736 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.635876 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.636054 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.636191 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.636363 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.636481 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.636671 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.636798 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.636977 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.637116 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.637281 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.637415 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.637583 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.637715 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.637935 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.638083 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.638238 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.638370 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.638565 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.638694 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.638878 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.639022 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.639190 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.639319 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.639506 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.639624 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.639809 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.639992 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.640110 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.640230 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.640408 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.640531 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.640731 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.640881 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.641042 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.641166 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.641356 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.641479 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.641668 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.641818 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.642006 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.642131 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.642321 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.642444 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.642628 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.642750 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.642942 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.643064 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.643837 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.644005 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.644163 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.644306 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.644758 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.644896 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.645081 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.645230 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.645399 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.645523 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.645716 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.645863 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.646057 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.646192 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.646376 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.646502 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.646691 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.646823 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.647005 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.647146 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.647317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.647439 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.647629 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.647880 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.648002 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.648223 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.648366 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.648535 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.648659 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.648861 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.648983 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.649183 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.649307 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.649502 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.649633 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.649840 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.649989 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.650158 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.650290 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.650476 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.650608 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.650796 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.650930 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.651116 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.651249 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.651422 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.651575 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.651739 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.651862 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.652051 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.652172 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.652363 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.652485 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.652673 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.652796 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.652983 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.653114 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.653298 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.653423 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.653609 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.653733 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.653944 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.654083 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.654252 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.654387 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.654570 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.654696 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.654884 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.655010 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.655193 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.655432 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.655556 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.655683 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.655832 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.655954 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.656147 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.656279 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.656460 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.656596 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.656776 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.656908 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.657093 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.657285 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.657425 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.657600 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.657722 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.657940 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.658073 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.658263 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.658386 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.658583 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.658765 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.658933 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.659064 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.659233 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.659498 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.659658 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.659824 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.659970 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.660148 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.660271 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.660494 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.660678 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.660802 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.661001 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.661125 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.661339 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.661470 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.661669 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.661820 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.662007 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.662131 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.662308 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.662432 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.662618 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.662763 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.662975 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.663142 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.663283 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.663492 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.663627 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.663807 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.663940 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.664133 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.664270 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.664459 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.664601 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.664760 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.664905 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.665066 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.665201 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.665387 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.665512 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.665690 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.665861 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.666019 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.666142 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.666339 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.666558 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.666692 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.666913 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.667039 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.667227 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.667349 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.667537 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.667667 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.667843 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.667986 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.668145 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.668268 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.668455 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.668583 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.668759 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.668887 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.669085 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.669219 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.669384 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.669516 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.669687 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.669833 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.670014 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.670162 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.670321 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.670452 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.670624 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.670746 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.670926 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.671080 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.671223 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.671366 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.671496 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.671631 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.671805 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.671947 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.672132 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.672262 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.672393 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.672529 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.672688 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.672833 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.672996 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.673162 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.673287 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.673401 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.673591 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.673712 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.673969 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.674097 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.674286 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.674415 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.674625 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.674805 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.674956 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.675106 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.675350 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.675526 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.675668 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.675785 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.675975 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.676121 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.676282 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.676418 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.676609 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.676733 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.676901 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.677023 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.677216 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.677321 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.677573 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.677794 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.677908 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.678120 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.678210 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.678442 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.678532 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.678775 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.678863 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.679103 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.679190 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.679409 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.679499 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.679714 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.679802 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.680018 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.680129 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.680341 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.680445 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.680650 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.680737 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.680958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.681204 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.681300 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.681542 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.681631 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.681881 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.681984 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.682193 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.682302 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.682499 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.682590 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.682806 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.682902 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.683117 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.683245 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.683419 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.683522 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.683727 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.683848 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.684034 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.684169 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.684342 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.684485 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.684651 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.684823 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.684963 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.685108 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.685317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.685518 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.685708 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.685993 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.686190 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.686370 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.686552 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.686736 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.686927 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.687104 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.687281 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.687457 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.687648 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.687827 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.688022 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.688222 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.688400 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.688576 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.688760 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.688945 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.689143 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.689329 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.689501 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.689672 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.689869 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.690619 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.690822 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.691034 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.691246 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.691484 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.691672 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.691862 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.692040 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.692219 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.692219 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.692498 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.692617 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.692745 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.692930 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.693058 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.693177 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.693300 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.693420 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.693561 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.693694 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.693863 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.693983 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.694100 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.694235 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.694354 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.694480 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.694597 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.694713 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.694829 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.694956 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.695075 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.695190 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.695375 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.695496 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.695613 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.695740 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.695859 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.695994 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.696129 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.696261 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.696385 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.696385 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.696593 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.696705 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.696813 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.696927 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.697049 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.697165 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.697287 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.697410 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.697533 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.697706 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.697876 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.698051 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.698174 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.698362 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.698487 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.698662 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.698786 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.698966 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.699084 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.699270 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.699398 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.699571 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.699704 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.699872 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.699995 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.700172 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.700293 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.700477 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.700610 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.700778 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.700900 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.701079 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.701201 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.701384 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.701506 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.701683 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.701826 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.702065 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.702210 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.702330 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.702432 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.702612 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.702735 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.702919 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.703058 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.703227 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.703356 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.703536 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.703659 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.703849 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.703981 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.704161 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.704288 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.704464 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.704607 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.704771 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.704927 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.705079 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.705209 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.705385 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.705512 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.706310 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.706447 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.706669 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.706942 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.707046 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.707301 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.707416 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.707616 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.707940 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.708207 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.708330 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.708565 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.708693 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.708890 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.709207 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.709521 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.709642 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.709887 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.709993 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.710204 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.710293 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.710522 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.710609 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.710838 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.710934 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.711153 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.711240 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.711467 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.711561 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.711782 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.711871 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.712099 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.712184 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.712429 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.712524 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.712725 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.712820 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.713045 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.713133 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.713358 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.713459 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.713669 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.713770 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.714017 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.714105 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.714327 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.714432 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.714646 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.714737 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.714958 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.715051 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.715267 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.715450 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.715584 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.715744 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.715900 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.716003 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.716216 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.716306 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.716536 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.716631 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.716843 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.716952 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.717157 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.717271 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.717477 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.717583 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.717812 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.717934 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.718144 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.718242 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.718474 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.718569 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.718788 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.718898 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.719116 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.719205 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.719448 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.719535 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.719794 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.719891 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.720036 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:11:17.720124 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.720441 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.720771 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.721089 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.721513 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.721969 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:11:17.722309 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:11:17.879674 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO dbcounter [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] Registered counter for database nova_api Aug 01 14:11:17.881240 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO dbcounter [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] Registered counter for database nova_api Aug 01 14:11:17.902297 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG oslo_db.sqlalchemy.engines [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:11:17.904847 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_db.sqlalchemy.engines [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:11:17.909871 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writer thread running {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:11:17.912775 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writer thread running {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:11:17.966675 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.context [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2f65a740-7946-42c2-9ae7-26876e964053(cell1) {{(pid=103717) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 14:11:17.969024 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.context [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2f65a740-7946-42c2-9ae7-26876e964053(cell1) {{(pid=103716) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 14:11:17.970577 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:17.972469 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:17.973077 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:17.973279 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:17.974705 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:17.975317 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:17.975508 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:17.977420 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO dbcounter [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] Registered counter for database nova_cell0 Aug 01 14:11:17.977585 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:17.979551 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO dbcounter [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] Registered counter for database nova_cell0 Aug 01 14:11:17.983179 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO dbcounter [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] Registered counter for database nova_cell1 Aug 01 14:11:17.985413 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO dbcounter [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] Registered counter for database nova_cell1 Aug 01 14:11:17.991432 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG oslo_db.sqlalchemy.engines [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:11:17.993701 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG oslo_db.sqlalchemy.engines [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:11:17.996170 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_db.sqlalchemy.engines [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:11:17.997374 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_db.sqlalchemy.engines [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:11:18.003701 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writer thread running {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:11:18.004620 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writer thread running {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:11:18.006129 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writer thread running {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:11:18.007675 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writer thread running {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:11:18.153533 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO dbcounter [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] Registered counter for database nova_cell0 Aug 01 14:11:18.160579 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_db.sqlalchemy.engines [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:11:18.165388 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writer thread running {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:11:18.242886 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO dbcounter [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] Registered counter for database nova_cell0 Aug 01 14:11:18.253527 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG oslo_db.sqlalchemy.engines [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:11:18.258211 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writer thread running {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:11:18.595381 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: WARNING keystonemiddleware.auth_token [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:11:18.602821 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: WARNING keystonemiddleware.auth_token [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:11:18.623984 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: WARNING keystonemiddleware.auth_token [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:11:18.632248 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: WARNING keystonemiddleware.auth_token [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:11:18.947139 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: WARNING keystonemiddleware.auth_token [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:11:18.953018 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: WARNING keystonemiddleware.auth_token [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:11:18.959006 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a7aa6e39c0 pid: 103716 (default app) Aug 01 14:11:18.961152 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:18.962457 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001856 Aug 01 14:11:18.962980 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Mon Aug 1 14:11:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:18.975181 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: WARNING keystonemiddleware.auth_token [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:11:18.981213 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: WARNING keystonemiddleware.auth_token [None req-5b1cb681-9f5a-4c84-9620-a4d7b37c0e31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:11:18.986614 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a7aa6e39c0 pid: 103717 (default app) Aug 01 14:12:39.763979 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:39.765172 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001775 Aug 01 14:12:39.765709 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 930 bytes} [Mon Aug 1 14:12:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:39.779331 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_api:SELECT=3 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:39.780757 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_cell0:SELECT=3 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:39.782681 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_cell1:SELECT=3 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:39.783698 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:40.748937 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-c6d16fe7-046e-4904-acaf-56869c63f45d admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:40.793307 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-c6d16fe7-046e-4904-acaf-56869c63f45d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.019240 Aug 01 14:12:40.794596 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1291 bytes} [Mon Aug 1 14:12:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:43.106049 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:43.109074 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-e12f1765-7d83-4128-9cdf-bd28113561b2 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002013 Aug 01 14:12:43.109074 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 930 bytes} [Mon Aug 1 14:12:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:43.631181 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-e278f065-c9ff-4cff-b78a-e1cc71347367 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "disk": 1, "ram": 256, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:43.653325 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:12:43.653325 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: warnings.warn(msg) Aug 01 14:12:43.737894 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-e278f065-c9ff-4cff-b78a-e1cc71347367 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.619256 Aug 01 14:12:43.746003 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Aug 1 14:12:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:43.754242 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_api:SELECT=3 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:43.756126 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_cell0:SELECT=3 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:43.757569 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_cell1:SELECT=3 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:43.759206 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:43.992056 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-89b5045d-8e4f-4e5e-83ce-358fe5265e24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:43.996612 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:12:43.996612 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: warnings.warn(msg) Aug 01 14:12:44.133688 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-89b5045d-8e4f-4e5e-83ce-358fe5265e24 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.384276 Aug 01 14:12:44.134699 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Aug 1 14:12:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:46.449924 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-e278f065-c9ff-4cff-b78a-e1cc71347367 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:46.450999 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-e278f065-c9ff-4cff-b78a-e1cc71347367 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001711 Aug 01 14:12:46.451415 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 930 bytes} [Mon Aug 1 14:12:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:47.244629 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-57dfabc9-09e0-45cd-b1ef-876bb48de202 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 5}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:47.264811 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:12:47.264811 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: warnings.warn(msg) Aug 01 14:12:47.389693 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-57dfabc9-09e0-45cd-b1ef-876bb48de202 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.931579 Aug 01 14:12:47.395671 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Aug 1 14:12:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:47.404307 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-e2d8255b-18e2-4f2a-a578-d2a7b0f2649b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:47.407843 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:12:47.407843 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: warnings.warn(msg) Aug 01 14:12:47.550900 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-e2d8255b-18e2-4f2a-a578-d2a7b0f2649b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.150901 Aug 01 14:12:47.552153 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Aug 1 14:12:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:49.844087 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-57dfabc9-09e0-45cd-b1ef-876bb48de202 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:49.845102 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-57dfabc9-09e0-45cd-b1ef-876bb48de202 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 01 14:12:49.845503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 930 bytes} [Mon Aug 1 14:12:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:50.264409 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-08cc2454-f2ad-4582-ac36-3c4b6ba8f295 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:50.389703 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-08cc2454-f2ad-4582-ac36-3c4b6ba8f295 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.538041 Aug 01 14:12:50.390304 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Aug 1 14:12:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:50.402874 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-df3282ed-9333-4aa1-8f7d-d00de4fc8f71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:50.505590 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-df3282ed-9333-4aa1-8f7d-d00de4fc8f71 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105513 Aug 01 14:12:50.506050 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Aug 1 14:12:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:52.776301 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-08cc2454-f2ad-4582-ac36-3c4b6ba8f295 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:52.777319 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-08cc2454-f2ad-4582-ac36-3c4b6ba8f295 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 01 14:12:52.777735 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 930 bytes} [Mon Aug 1 14:12:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:53.303486 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-d5506a3a-ea86-45a3-803a-7df0f0706693 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "name": "ds2G", "id": "d3", "os-flavor-access:is_public": true, "swap": 0, "disk": 10}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:53.390401 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-d5506a3a-ea86-45a3-803a-7df0f0706693 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.606009 Aug 01 14:12:53.398607 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Aug 1 14:12:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:53.403347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-7744f468-a82c-4c44-b1d2-c5c1c27e6fa7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:53.478302 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-7744f468-a82c-4c44-b1d2-c5c1c27e6fa7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078564 Aug 01 14:12:53.479258 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Aug 1 14:12:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:55.829809 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-d5506a3a-ea86-45a3-803a-7df0f0706693 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:55.831443 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-d5506a3a-ea86-45a3-803a-7df0f0706693 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002050 Aug 01 14:12:55.832037 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 930 bytes} [Mon Aug 1 14:12:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:56.299904 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-6d0bee91-2dc9-45b7-8e2f-11600b804621 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4, "ram": 4096}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:56.407633 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-6d0bee91-2dc9-45b7-8e2f-11600b804621 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.569351 Aug 01 14:12:56.408577 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Aug 1 14:12:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:56.420636 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-0c4c24b3-bd0b-4183-b9d7-404df5271ec7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:56.560272 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-0c4c24b3-bd0b-4183-b9d7-404df5271ec7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.143122 Aug 01 14:12:56.560812 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Aug 1 14:12:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:59.266539 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-6d0bee91-2dc9-45b7-8e2f-11600b804621 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:59.267713 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-6d0bee91-2dc9-45b7-8e2f-11600b804621 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001763 Aug 01 14:12:59.268320 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 930 bytes} [Mon Aug 1 14:12:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:59.766225 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-0a66e36a-faca-4263-be2a-7c75eee6fa71 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:59.794282 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-0a66e36a-faca-4263-be2a-7c75eee6fa71 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.517518 Aug 01 14:12:59.794848 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1291 bytes} [Mon Aug 1 14:12:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:02.130157 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-6d0bee91-2dc9-45b7-8e2f-11600b804621 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:02.131667 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-6d0bee91-2dc9-45b7-8e2f-11600b804621 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002476 Aug 01 14:13:02.132281 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 930 bytes} [Mon Aug 1 14:13:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:02.604551 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-991af1a3-9df5-4742-b146-5eca962f9794 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "disk": 1}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:02.687418 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-991af1a3-9df5-4742-b146-5eca962f9794 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.548487 Aug 01 14:13:02.688308 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Aug 1 14:13:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:13:02.701948 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-92824807-ba42-401d-8574-31afeac36e45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:02.784432 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-92824807-ba42-401d-8574-31afeac36e45 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087191 Aug 01 14:13:02.785217 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Aug 1 14:13:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:05.091232 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-991af1a3-9df5-4742-b146-5eca962f9794 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:05.092248 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-991af1a3-9df5-4742-b146-5eca962f9794 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 01 14:13:05.092843 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 930 bytes} [Mon Aug 1 14:13:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:05.541257 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-90992aaa-1dde-4f9e-95e0-413c267e5066 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:05.626119 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-90992aaa-1dde-4f9e-95e0-413c267e5066 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.526510 Aug 01 14:13:05.626590 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Aug 1 14:13:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:13:05.640069 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-adf12c7c-e616-41b5-bfa7-fa9e8355ecd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:05.745271 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-adf12c7c-e616-41b5-bfa7-fa9e8355ecd8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108956 Aug 01 14:13:05.746262 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Aug 1 14:13:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:08.051874 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-90992aaa-1dde-4f9e-95e0-413c267e5066 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:08.053535 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-90992aaa-1dde-4f9e-95e0-413c267e5066 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002713 Aug 01 14:13:08.059429 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 930 bytes} [Mon Aug 1 14:13:08 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:08.432404 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-fa11951a-d72d-4420-a5d3-1b11c8673a25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "name": "m1.medium", "vcpus": 2, "id": "3"}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:08.563316 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-fa11951a-d72d-4420-a5d3-1b11c8673a25 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.502644 Aug 01 14:13:08.563816 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Aug 1 14:13:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:13:08.575653 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-d5867d98-ac64-47cb-9f76-e060ba200054 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:08.658936 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-d5867d98-ac64-47cb-9f76-e060ba200054 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086946 Aug 01 14:13:08.659512 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Aug 1 14:13:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:10.941227 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-fa11951a-d72d-4420-a5d3-1b11c8673a25 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:10.943115 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-fa11951a-d72d-4420-a5d3-1b11c8673a25 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002407 Aug 01 14:13:10.943730 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 930 bytes} [Mon Aug 1 14:13:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:11.378427 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-6c3184e7-f389-4b71-a23b-8a58236d7a29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:11.384933 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:11.466414 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-6c3184e7-f389-4b71-a23b-8a58236d7a29 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.513738 Aug 01 14:13:11.476222 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-8c6312d1-57d3-44df-a554-8d3470bd6e8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:11.476595 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Aug 1 14:13:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:13:11.606127 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-8c6312d1-57d3-44df-a554-8d3470bd6e8d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.133503 Aug 01 14:13:11.606967 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Aug 1 14:13:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:13:13.913715 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-6c3184e7-f389-4b71-a23b-8a58236d7a29 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:13.914824 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-6c3184e7-f389-4b71-a23b-8a58236d7a29 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Aug 01 14:13:13.915677 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 930 bytes} [Mon Aug 1 14:13:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:14.408120 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-09e2d8f9-1c3d-4d47-8479-0563bfd96fb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "vcpus": 8, "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:14.529442 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-09e2d8f9-1c3d-4d47-8479-0563bfd96fb5 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.607712 Aug 01 14:13:14.537806 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Aug 1 14:13:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:13:14.543121 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-2349eb0f-c350-4595-99a5-c697819f14d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:14.651576 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-2349eb0f-c350-4595-99a5-c697819f14d1 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112825 Aug 01 14:13:14.652375 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Aug 1 14:13:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:13:35.606569 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-09e2d8f9-1c3d-4d47-8479-0563bfd96fb5 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:35.607660 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-09e2d8f9-1c3d-4d47-8479-0563bfd96fb5 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 01 14:13:35.608070 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 930 bytes} [Mon Aug 1 14:13:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:36.025843 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-e0467923-5338-420f-a671-536de5a26c60 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:36.044581 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-e0467923-5338-420f-a671-536de5a26c60 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.429646 Aug 01 14:13:36.045128 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1291 bytes} [Mon Aug 1 14:13:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:37.144510 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-09e2d8f9-1c3d-4d47-8479-0563bfd96fb5 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:37.145660 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-09e2d8f9-1c3d-4d47-8479-0563bfd96fb5 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001951 Aug 01 14:13:37.145940 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Aug 1 14:13:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:37.691834 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-c654e742-f479-4207-865f-ccfed7c981b7 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:37.697836 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.wsgi [None req-c654e742-f479-4207-865f-ccfed7c981b7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-c654e742-f479-4207-865f-ccfed7c981b7 admin admin] Request method failure captured: Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Accept: application/json Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Accept-Encoding: gzip, deflate Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Connection: keep-alive Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Content-Length: 0 Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Host: 10.222.0.49 Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Openstack-Api-Version: compute 2.90 Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Openstack-System-Scope: None Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: User-Agent: python-novaclient Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Auth-Token: gAAAAABi59-R8E9LsTzrO-JONo7ZgvX13tygz1uexbpzvOiMsPVxM1kKIO3DtgjPbm2y_NuLYR5e8JJ2jb3wrRBnuF6tA5uMTqnc_HCtwyWN5EB1SOOcPRPG1o83LQvzOdHMecVngatn1sRD1BJwXCPkME3RRk0iMRg-lbtjukzEiJ_mq4-qbWc Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Domain-Id: None Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Domain-Name: None Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Identity-Status: Confirmed Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Is-Admin-Project: True Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Project-Domain-Id: default Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Project-Domain-Name: Default Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Project-Id: 40846723d7f04d9ab8a9bf11d431617b Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Project-Name: admin Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Role: reader,member,admin Aug 01 14:13:37.701140 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Roles: reader,member,admin Aug 01 14:13:37.702841 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:13:37.702841 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Tenant: admin Aug 01 14:13:37.702841 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Tenant-Id: 40846723d7f04d9ab8a9bf11d431617b Aug 01 14:13:37.702841 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Tenant-Name: admin Aug 01 14:13:37.702841 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-User: admin Aug 01 14:13:37.702841 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-User-Domain-Id: default Aug 01 14:13:37.702841 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-User-Domain-Name: Default Aug 01 14:13:37.702841 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-User-Id: f199c9c45ff44aa0a14a3b7dc647ab4c Aug 01 14:13:37.702841 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-User-Name: admin Aug 01 14:13:37.702841 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: method: > Aug 01 14:13:37.702841 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: exception: Flavor 42 could not be found. Aug 01 14:13:37.702841 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: action_args: {'id': '42'} Aug 01 14:13:37.702841 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:13:37.702841 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:37.704006 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 01 14:13:37.705347 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-c654e742-f479-4207-865f-ccfed7c981b7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:13:37.706646 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-c654e742-f479-4207-865f-ccfed7c981b7 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.418104 Aug 01 14:13:37.706646 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Aug 1 14:13:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:37.719337 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-95c51911-7e2e-45a8-bfaf-a375ec4629ed admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:37.724120 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:37.743424 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-95c51911-7e2e-45a8-bfaf-a375ec4629ed admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027620 Aug 01 14:13:37.744008 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Aug 1 14:13:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:37.755177 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-fb835b38-d92b-4ba2-96a2-13b2dec14307 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:37.779594 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-fb835b38-d92b-4ba2-96a2-13b2dec14307 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028797 Aug 01 14:13:37.780154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Aug 1 14:13:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:37.790836 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-842d4708-05e2-4f87-931f-c647ab6f2b40 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:37.796682 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.wsgi [None req-842d4708-05e2-4f87-931f-c647ab6f2b40 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-842d4708-05e2-4f87-931f-c647ab6f2b40 admin admin] Request method failure captured: Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Accept: application/json Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Accept-Encoding: gzip, deflate Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Connection: keep-alive Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Content-Length: 0 Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Host: 10.222.0.49 Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Openstack-Api-Version: compute 2.90 Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Openstack-System-Scope: None Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: User-Agent: python-novaclient Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Auth-Token: gAAAAABi59-R8E9LsTzrO-JONo7ZgvX13tygz1uexbpzvOiMsPVxM1kKIO3DtgjPbm2y_NuLYR5e8JJ2jb3wrRBnuF6tA5uMTqnc_HCtwyWN5EB1SOOcPRPG1o83LQvzOdHMecVngatn1sRD1BJwXCPkME3RRk0iMRg-lbtjukzEiJ_mq4-qbWc Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Domain-Id: None Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Domain-Name: None Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Identity-Status: Confirmed Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Is-Admin-Project: True Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Project-Domain-Id: default Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Project-Domain-Name: Default Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Project-Id: 40846723d7f04d9ab8a9bf11d431617b Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Project-Name: admin Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Role: reader,member,admin Aug 01 14:13:37.799958 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Roles: reader,member,admin Aug 01 14:13:37.809019 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:13:37.809019 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Tenant: admin Aug 01 14:13:37.809019 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Tenant-Id: 40846723d7f04d9ab8a9bf11d431617b Aug 01 14:13:37.809019 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Tenant-Name: admin Aug 01 14:13:37.809019 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-User: admin Aug 01 14:13:37.809019 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-User-Domain-Id: default Aug 01 14:13:37.809019 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-User-Domain-Name: Default Aug 01 14:13:37.809019 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-User-Id: f199c9c45ff44aa0a14a3b7dc647ab4c Aug 01 14:13:37.809019 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-User-Name: admin Aug 01 14:13:37.809019 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: method: > Aug 01 14:13:37.809019 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: exception: Flavor 42 could not be found. Aug 01 14:13:37.809019 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: action_args: {'id': '42'} Aug 01 14:13:37.809019 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:13:37.809019 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:37.810032 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Aug 01 14:13:37.811317 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-842d4708-05e2-4f87-931f-c647ab6f2b40 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:13:37.812688 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-842d4708-05e2-4f87-931f-c647ab6f2b40 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015082 Aug 01 14:13:37.812688 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Aug 1 14:13:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:38.790196 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-fb835b38-d92b-4ba2-96a2-13b2dec14307 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:38.791215 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-fb835b38-d92b-4ba2-96a2-13b2dec14307 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 01 14:13:38.791605 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Aug 1 14:13:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:39.328165 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-bd100eb5-152b-41ac-bef7-5d12b9371132 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:39.334535 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.wsgi [None req-bd100eb5-152b-41ac-bef7-5d12b9371132 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-bd100eb5-152b-41ac-bef7-5d12b9371132 admin admin] Request method failure captured: Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Accept: application/json Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Accept-Encoding: gzip, deflate Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Connection: keep-alive Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Content-Length: 0 Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Host: 10.222.0.49 Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Openstack-Api-Version: compute 2.90 Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Openstack-System-Scope: None Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: User-Agent: python-novaclient Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Auth-Token: gAAAAABi59-SN2OGHctqKpPcU5yi6lM_HJyNgXCSiq0IUUaV5C6bokAk0B24UVmsYkHPRi6jAQsepJkZ_NgWng_B0Uku_hzk5EF4V0EQtc_TIt1uHLMNfSJ5rsTRAJ4lbZakzefHuqPlPnVzYpkjIuiFHAt8Zjkl2Zsvb0FtkzAzS06FlKCVlOA Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Domain-Id: None Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Domain-Name: None Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Identity-Status: Confirmed Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Is-Admin-Project: True Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Project-Domain-Id: default Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Project-Domain-Name: Default Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Project-Id: 40846723d7f04d9ab8a9bf11d431617b Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Project-Name: admin Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Role: reader,member,admin Aug 01 14:13:39.336064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Roles: reader,member,admin Aug 01 14:13:39.337483 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:13:39.337483 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Tenant: admin Aug 01 14:13:39.337483 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Tenant-Id: 40846723d7f04d9ab8a9bf11d431617b Aug 01 14:13:39.337483 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Tenant-Name: admin Aug 01 14:13:39.337483 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-User: admin Aug 01 14:13:39.337483 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-User-Domain-Id: default Aug 01 14:13:39.337483 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-User-Domain-Name: Default Aug 01 14:13:39.337483 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-User-Id: f199c9c45ff44aa0a14a3b7dc647ab4c Aug 01 14:13:39.337483 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-User-Name: admin Aug 01 14:13:39.337483 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: method: > Aug 01 14:13:39.337483 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: exception: Flavor 84 could not be found. Aug 01 14:13:39.337483 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: action_args: {'id': '84'} Aug 01 14:13:39.337483 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:13:39.337483 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:39.338372 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Aug 01 14:13:39.339721 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-bd100eb5-152b-41ac-bef7-5d12b9371132 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:13:39.340963 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-bd100eb5-152b-41ac-bef7-5d12b9371132 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.407300 Aug 01 14:13:39.340963 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Aug 1 14:13:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:39.348649 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-1264d9e8-20ed-4715-9994-3eb5dabedfcd admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:39.364297 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-1264d9e8-20ed-4715-9994-3eb5dabedfcd admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020436 Aug 01 14:13:39.364870 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Aug 1 14:13:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:39.375110 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-b69e1a5e-39df-4977-92e6-fcdc34bdd8be admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:39.390647 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-b69e1a5e-39df-4977-92e6-fcdc34bdd8be admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019326 Aug 01 14:13:39.391193 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Aug 1 14:13:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:39.401551 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-c30c967c-bfc7-499f-8d0a-f52c36ca1d6e admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:39.407088 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.wsgi [None req-c30c967c-bfc7-499f-8d0a-f52c36ca1d6e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-c30c967c-bfc7-499f-8d0a-f52c36ca1d6e admin admin] Request method failure captured: Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Accept: application/json Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Accept-Encoding: gzip, deflate Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Connection: keep-alive Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Content-Length: 0 Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Host: 10.222.0.49 Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Openstack-Api-Version: compute 2.90 Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Openstack-System-Scope: None Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: User-Agent: python-novaclient Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Auth-Token: gAAAAABi59-SN2OGHctqKpPcU5yi6lM_HJyNgXCSiq0IUUaV5C6bokAk0B24UVmsYkHPRi6jAQsepJkZ_NgWng_B0Uku_hzk5EF4V0EQtc_TIt1uHLMNfSJ5rsTRAJ4lbZakzefHuqPlPnVzYpkjIuiFHAt8Zjkl2Zsvb0FtkzAzS06FlKCVlOA Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Domain-Id: None Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Domain-Name: None Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Identity-Status: Confirmed Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Is-Admin-Project: True Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Project-Domain-Id: default Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Project-Domain-Name: Default Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Project-Id: 40846723d7f04d9ab8a9bf11d431617b Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Project-Name: admin Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Role: reader,member,admin Aug 01 14:13:39.418036 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Roles: reader,member,admin Aug 01 14:13:39.419809 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:13:39.419809 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Tenant: admin Aug 01 14:13:39.419809 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Tenant-Id: 40846723d7f04d9ab8a9bf11d431617b Aug 01 14:13:39.419809 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Tenant-Name: admin Aug 01 14:13:39.419809 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-User: admin Aug 01 14:13:39.419809 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-User-Domain-Id: default Aug 01 14:13:39.419809 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-User-Domain-Name: Default Aug 01 14:13:39.419809 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-User-Id: f199c9c45ff44aa0a14a3b7dc647ab4c Aug 01 14:13:39.419809 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-User-Name: admin Aug 01 14:13:39.419809 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: method: > Aug 01 14:13:39.419809 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: exception: Flavor 84 could not be found. Aug 01 14:13:39.419809 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: action_args: {'id': '84'} Aug 01 14:13:39.419809 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:13:39.419809 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:39.420775 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 01 14:13:39.422154 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-c30c967c-bfc7-499f-8d0a-f52c36ca1d6e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:13:39.423367 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-c30c967c-bfc7-499f-8d0a-f52c36ca1d6e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012058 Aug 01 14:13:39.423367 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Aug 1 14:13:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 01 14:13:40.413483 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-b69e1a5e-39df-4977-92e6-fcdc34bdd8be admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:40.418987 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-b69e1a5e-39df-4977-92e6-fcdc34bdd8be admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Aug 01 14:13:40.418987 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Aug 1 14:13:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:40.962685 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-08545c13-ee8d-416b-9ece-6ce16e2bff5e admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:40.968629 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.wsgi [None req-08545c13-ee8d-416b-9ece-6ce16e2bff5e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-08545c13-ee8d-416b-9ece-6ce16e2bff5e admin admin] Request method failure captured: Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Accept: application/json Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Accept-Encoding: gzip, deflate Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Connection: keep-alive Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Content-Length: 0 Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Host: 10.222.0.49 Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Openstack-Api-Version: compute 2.90 Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Openstack-System-Scope: None Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: User-Agent: python-novaclient Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Auth-Token: gAAAAABi59-Ug4eITphYRptMPdWHR_pZjC4qPef3u6ngfWsnm7K8gaYeb8FYDxInSHd-ocs-MW134dutBA0KhU7izHKzY7IZdSTWm7J1UrCsRCs6auCPTDh34ZJ9zRzwq1js_UqLA4iQISY48tyVFbEtwreX6g0P2fWDikZlRYaWRa4g8prktNc Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Domain-Id: None Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Domain-Name: None Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Identity-Status: Confirmed Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Is-Admin-Project: True Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Project-Domain-Id: default Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Project-Domain-Name: Default Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Project-Id: 40846723d7f04d9ab8a9bf11d431617b Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Project-Name: admin Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Role: reader,member,admin Aug 01 14:13:40.970197 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Roles: reader,member,admin Aug 01 14:13:40.971712 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:13:40.971712 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Tenant: admin Aug 01 14:13:40.971712 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Tenant-Id: 40846723d7f04d9ab8a9bf11d431617b Aug 01 14:13:40.971712 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-Tenant-Name: admin Aug 01 14:13:40.971712 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-User: admin Aug 01 14:13:40.971712 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-User-Domain-Id: default Aug 01 14:13:40.971712 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-User-Domain-Name: Default Aug 01 14:13:40.971712 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-User-Id: f199c9c45ff44aa0a14a3b7dc647ab4c Aug 01 14:13:40.971712 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: X-User-Name: admin Aug 01 14:13:40.971712 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: method: > Aug 01 14:13:40.971712 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: exception: Flavor 451 could not be found. Aug 01 14:13:40.971712 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: action_args: {'id': '451'} Aug 01 14:13:40.971712 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:13:40.971712 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:40.973208 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 01 14:13:40.974570 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-08545c13-ee8d-416b-9ece-6ce16e2bff5e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:13:40.975774 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-08545c13-ee8d-416b-9ece-6ce16e2bff5e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.415921 Aug 01 14:13:40.975774 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Aug 1 14:13:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:40.987043 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-c4bc66b6-0e39-465f-9847-15495ae8b0f5 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:41.002901 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-c4bc66b6-0e39-465f-9847-15495ae8b0f5 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021886 Aug 01 14:13:41.004039 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Aug 1 14:13:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:41.014107 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-e5b739bf-75bf-4a5e-8492-3c82dff29659 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:41.029348 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-e5b739bf-75bf-4a5e-8492-3c82dff29659 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019160 Aug 01 14:13:41.029909 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Aug 1 14:13:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:13:41.040116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-096aa23f-abad-468e-89f2-087de68deeb8 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:41.045562 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.wsgi [None req-096aa23f-abad-468e-89f2-087de68deeb8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-096aa23f-abad-468e-89f2-087de68deeb8 admin admin] Request method failure captured: Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Accept: application/json Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Accept-Encoding: gzip, deflate Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Connection: keep-alive Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Content-Length: 0 Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Host: 10.222.0.49 Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Openstack-Api-Version: compute 2.90 Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Openstack-System-Scope: None Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: User-Agent: python-novaclient Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Auth-Token: gAAAAABi59-Ug4eITphYRptMPdWHR_pZjC4qPef3u6ngfWsnm7K8gaYeb8FYDxInSHd-ocs-MW134dutBA0KhU7izHKzY7IZdSTWm7J1UrCsRCs6auCPTDh34ZJ9zRzwq1js_UqLA4iQISY48tyVFbEtwreX6g0P2fWDikZlRYaWRa4g8prktNc Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Domain-Id: None Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Domain-Name: None Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Identity-Status: Confirmed Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Is-Admin-Project: True Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Project-Domain-Id: default Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Project-Domain-Name: Default Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Project-Id: 40846723d7f04d9ab8a9bf11d431617b Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Project-Name: admin Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Role: reader,member,admin Aug 01 14:13:41.047116 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Roles: reader,member,admin Aug 01 14:13:41.048507 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/40846723d7f04d9ab8a9bf11d431617b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:13:41.048507 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Tenant: admin Aug 01 14:13:41.048507 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Tenant-Id: 40846723d7f04d9ab8a9bf11d431617b Aug 01 14:13:41.048507 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-Tenant-Name: admin Aug 01 14:13:41.048507 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-User: admin Aug 01 14:13:41.048507 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-User-Domain-Id: default Aug 01 14:13:41.048507 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-User-Domain-Name: Default Aug 01 14:13:41.048507 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-User-Id: f199c9c45ff44aa0a14a3b7dc647ab4c Aug 01 14:13:41.048507 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: X-User-Name: admin Aug 01 14:13:41.048507 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: method: > Aug 01 14:13:41.048507 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: exception: Flavor 451 could not be found. Aug 01 14:13:41.048507 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: action_args: {'id': '451'} Aug 01 14:13:41.048507 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:13:41.048507 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:41.049408 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Aug 01 14:13:41.051503 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-096aa23f-abad-468e-89f2-087de68deeb8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:13:41.053244 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-096aa23f-abad-468e-89f2-087de68deeb8 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012044 Aug 01 14:13:41.053244 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Aug 1 14:13:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:42.041535 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-e5b739bf-75bf-4a5e-8492-3c82dff29659 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:42.042592 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-e5b739bf-75bf-4a5e-8492-3c82dff29659 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 01 14:13:42.042975 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Aug 1 14:13:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:42.617460 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-02577846-fd79-4367-b2d3-849071844247 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:42.685500 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-02577846-fd79-4367-b2d3-849071844247 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.498162 Aug 01 14:13:42.686072 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Aug 1 14:13:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:13:43.697286 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-e5b739bf-75bf-4a5e-8492-3c82dff29659 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:43.698331 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-e5b739bf-75bf-4a5e-8492-3c82dff29659 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 01 14:13:43.698732 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Aug 1 14:13:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:44.240919 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-d1e56e89-6242-4a3c-ae28-b6952d6e7a84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:44.310630 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-d1e56e89-6242-4a3c-ae28-b6952d6e7a84 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.469566 Aug 01 14:13:44.311107 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Aug 1 14:13:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:13:45.302333 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-e5b739bf-75bf-4a5e-8492-3c82dff29659 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:45.303368 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-e5b739bf-75bf-4a5e-8492-3c82dff29659 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 01 14:13:45.303761 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Aug 1 14:13:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:45.852187 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-956e653c-d9e2-487d-bd08-f10820f4052a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:45.922830 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-956e653c-d9e2-487d-bd08-f10820f4052a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.478779 Aug 01 14:13:45.923437 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Aug 1 14:13:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:13:46.924153 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-e5b739bf-75bf-4a5e-8492-3c82dff29659 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:46.925983 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-e5b739bf-75bf-4a5e-8492-3c82dff29659 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 01 14:13:46.926459 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Aug 1 14:13:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:47.580082 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-46d0d740-11e2-4e73-8cbd-b8a988af661e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:47.671064 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-46d0d740-11e2-4e73-8cbd-b8a988af661e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.606221 Aug 01 14:13:47.671527 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Aug 1 14:13:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:13:48.670989 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-e5b739bf-75bf-4a5e-8492-3c82dff29659 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:48.671989 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-e5b739bf-75bf-4a5e-8492-3c82dff29659 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 01 14:13:48.672379 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Aug 1 14:13:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:49.281518 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-0885609f-db81-4e93-8f2e-02aef8e0869b admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:49.303532 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-0885609f-db81-4e93-8f2e-02aef8e0869b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.453490 Aug 01 14:13:49.304079 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Mon Aug 1 14:13:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:41.634989 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-e5b739bf-75bf-4a5e-8492-3c82dff29659 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:41.635991 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-e5b739bf-75bf-4a5e-8492-3c82dff29659 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 01 14:14:41.636380 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 930 bytes} [Mon Aug 1 14:14:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:41.647636 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:42.068312 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-6f278f7b-4a07-458f-ae71-d0f16a5c8e45 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:42.091035 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-6f278f7b-4a07-458f-ae71-d0f16a5c8e45 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.448049 Aug 01 14:14:42.091154 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1291 bytes} [Mon Aug 1 14:14:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:42.113343 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:42.117291 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-f7bcd1c2-2124-48cb-9b3c-06da6638806c admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:42.125108 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-f7bcd1c2-2124-48cb-9b3c-06da6638806c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014071 Aug 01 14:14:42.125910 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1282 bytes} [Mon Aug 1 14:14:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:42.138381 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-8fb2ddd3-6113-4ea8-9e49-9c06766ae86c admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:42.147631 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-8fb2ddd3-6113-4ea8-9e49-9c06766ae86c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012956 Aug 01 14:14:42.148181 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1285 bytes} [Mon Aug 1 14:14:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:42.160519 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-1def5906-0046-4a75-a305-8872f4614e52 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:42.168385 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-1def5906-0046-4a75-a305-8872f4614e52 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012156 Aug 01 14:14:42.168934 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1285 bytes} [Mon Aug 1 14:14:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:42.181052 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-10a62323-38c3-444f-be78-744598528f90 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:42.188940 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-10a62323-38c3-444f-be78-744598528f90 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011490 Aug 01 14:14:42.189479 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1282 bytes} [Mon Aug 1 14:14:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:19.863114 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-1def5906-0046-4a75-a305-8872f4614e52 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:19.864126 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-1def5906-0046-4a75-a305-8872f4614e52 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 01 14:18:19.865165 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Aug 1 14:18:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:20.008939 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_api:SELECT=6 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:20.174201 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-e33b61cf-a3df-42c6-8721-5d8dd9ee0582 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:20.176622 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:18:20.176622 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: warnings.warn(msg) Aug 01 14:18:20.178747 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-e33b61cf-a3df-42c6-8721-5d8dd9ee0582 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:20.179191 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-e33b61cf-a3df-42c6-8721-5d8dd9ee0582 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:20.180146 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-e33b61cf-a3df-42c6-8721-5d8dd9ee0582 admin admin] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:20.180574 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-e33b61cf-a3df-42c6-8721-5d8dd9ee0582 admin admin] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:20.215352 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-e33b61cf-a3df-42c6-8721-5d8dd9ee0582 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.207740 Aug 01 14:18:20.215922 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Aug 1 14:18:20 2022] GET /compute/v2.1/os-services => generated 794 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:18:21.057921 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-1def5906-0046-4a75-a305-8872f4614e52 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:21.058937 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-1def5906-0046-4a75-a305-8872f4614e52 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 01 14:18:21.059339 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Aug 1 14:18:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:21.255952 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-e5ffe812-f6ba-4a80-b170-ee63f289383a admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:21.258346 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:18:21.258346 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: warnings.warn(msg) Aug 01 14:18:21.259535 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-e5ffe812-f6ba-4a80-b170-ee63f289383a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:21.259972 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-e5ffe812-f6ba-4a80-b170-ee63f289383a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:21.260745 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-e5ffe812-f6ba-4a80-b170-ee63f289383a admin admin] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:21.261169 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-e5ffe812-f6ba-4a80-b170-ee63f289383a admin admin] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:21.280877 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-e5ffe812-f6ba-4a80-b170-ee63f289383a admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.079872 Aug 01 14:18:21.281375 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Aug 1 14:18:21 2022] GET /compute/v2.1/os-services => generated 794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:18:32.585257 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-1def5906-0046-4a75-a305-8872f4614e52 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:32.586284 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-1def5906-0046-4a75-a305-8872f4614e52 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 01 14:18:32.586677 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Aug 1 14:18:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:18:32.732069 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_cell0:SELECT=4 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:32.732807 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_cell1:SELECT=4 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:32.733424 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_api:SELECT=8 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:32.784126 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-dee441b9-37a5-4acf-893b-adfe91a209dd admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:32.786544 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:18:32.786544 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: warnings.warn(msg) Aug 01 14:18:32.787916 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-dee441b9-37a5-4acf-893b-adfe91a209dd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:32.788359 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-dee441b9-37a5-4acf-893b-adfe91a209dd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:32.789181 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-dee441b9-37a5-4acf-893b-adfe91a209dd admin admin] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:32.789609 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-dee441b9-37a5-4acf-893b-adfe91a209dd admin admin] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:32.816661 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-dee441b9-37a5-4acf-893b-adfe91a209dd admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.089081 Aug 01 14:18:32.817146 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Aug 1 14:18:32 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:33.651167 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-1def5906-0046-4a75-a305-8872f4614e52 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:33.652165 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-1def5906-0046-4a75-a305-8872f4614e52 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 01 14:18:33.652561 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Aug 1 14:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:33.863255 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-c1faa8a2-cea3-476b-a98c-e02e99fb5324 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:33.867616 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:18:33.867616 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: warnings.warn(msg) Aug 01 14:18:33.869052 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-c1faa8a2-cea3-476b-a98c-e02e99fb5324 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:33.869611 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-c1faa8a2-cea3-476b-a98c-e02e99fb5324 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:33.870558 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-c1faa8a2-cea3-476b-a98c-e02e99fb5324 admin admin] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:33.871126 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-c1faa8a2-cea3-476b-a98c-e02e99fb5324 admin admin] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:33.897368 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-c1faa8a2-cea3-476b-a98c-e02e99fb5324 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.100937 Aug 01 14:18:33.898020 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Aug 1 14:18:33 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:31.635348 dv-cinder-787296-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 01 14:19:31.635954 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: Mon Aug 1 14:19:31 2022 - graceful shutdown triggered... Aug 01 14:19:31.636404 dv-cinder-787296-13-iscsi devstack@n-api.service[103716]: Gracefully killing worker 1 (pid: 103716)... Aug 01 14:19:31.636826 dv-cinder-787296-13-iscsi devstack@n-api.service[103717]: Gracefully killing worker 2 (pid: 103717)... Aug 01 14:19:32.636517 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: worker 1 buried after 1 seconds Aug 01 14:19:32.637108 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: worker 2 buried after 1 seconds Aug 01 14:19:32.637108 dv-cinder-787296-13-iscsi devstack@n-api.service[103715]: goodbye to uWSGI. Aug 01 14:19:32.638168 dv-cinder-787296-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 01 14:19:32.638729 dv-cinder-787296-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 01 14:19:32.641539 dv-cinder-787296-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 14:19:32.654059 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 14:19:32.656215 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 14:19:32 2022] *** Aug 01 14:19:32.656215 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 14:19:32.656215 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 14:19:32.656215 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: nodename: dv-cinder-787296-13-iscsi Aug 01 14:19:32.656215 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: machine: x86_64 Aug 01 14:19:32.656215 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: clock source: unix Aug 01 14:19:32.656215 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: pcre jit disabled Aug 01 14:19:32.656215 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: detected number of CPU cores: 4 Aug 01 14:19:32.656215 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: current working directory: / Aug 01 14:19:32.656215 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: detected binary path: /usr/bin/uwsgi-core Aug 01 14:19:32.656990 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: your processes number limit is 47680 Aug 01 14:19:32.656990 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: your memory page size is 4096 bytes Aug 01 14:19:32.656990 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: detected max file descriptor number: 2048 Aug 01 14:19:32.656990 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: lock engine: pthread robust mutexes Aug 01 14:19:32.656990 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: thunder lock: enabled Aug 01 14:19:32.656990 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 14:19:32.656990 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 14:19:32.700921 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: Python main interpreter initialized at 0x556f9e0c69c0 Aug 01 14:19:32.700921 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: python threads support enabled Aug 01 14:19:32.700921 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: your server socket listen backlog is limited to 100 connections Aug 01 14:19:32.700921 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: your mercy for graceful operations on workers is 90 seconds Aug 01 14:19:32.700921 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 14:19:32.700921 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: *** Operational MODE: preforking *** Aug 01 14:19:32.700921 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: *** uWSGI is running in multiple interpreter mode *** Aug 01 14:19:32.700921 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: spawned uWSGI master process (pid: 118225) Aug 01 14:19:32.700921 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: spawned uWSGI worker 1 (pid: 118246, cores: 1) Aug 01 14:19:32.700921 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: spawned uWSGI worker 2 (pid: 118247, cores: 1) Aug 01 14:19:32.700921 dv-cinder-787296-13-iscsi devstack@n-api.service[118225]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 14:19:32.698806 dv-cinder-787296-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 14:19:33.380283 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 14:19:33.422314 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 14:19:34.562667 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:19:34.562667 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: from cryptography.utils import int_from_bytes Aug 01 14:19:34.563331 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:19:34.563331 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: from cryptography.utils import int_from_bytes Aug 01 14:19:34.614123 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:19:34.614123 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: from cryptography.utils import int_from_bytes Aug 01 14:19:34.614770 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:19:34.614770 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: from cryptography.utils import int_from_bytes Aug 01 14:19:37.027017 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:19:37.027804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:19:37.027804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:19:37.028115 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:19:37.028379 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:19:37.028784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.029124 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.029688 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.030075 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.030421 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.030746 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.031082 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.031414 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.031752 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.032023 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.032351 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.032685 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-13-iscsi {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.033211 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.033715 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.034076 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.034415 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.034734 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.035097 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.035525 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.035965 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.036381 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.036699 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.037024 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.037376 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.037717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.038074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.038399 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.038735 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.039609 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.039921 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.040354 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-13-iscsi {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.040672 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.041009 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.041315 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.041796 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.042095 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.042424 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.042747 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.043244 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.043500 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.043718 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.044045 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.044373 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.044700 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.045011 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.045324 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.045642 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.046002 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.046318 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.046630 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.046883 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.047197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.047527 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.047858 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.048189 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.048446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.048703 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.049032 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.049365 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.049677 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.050022 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.050389 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.050653 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.050968 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.051283 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.051674 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.051912 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.052241 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.052564 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.052899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.053214 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.053542 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.053986 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.054245 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.054559 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.055469 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.055904 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.056302 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.056635 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.056966 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.058101 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.058101 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.058101 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.058606 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.058606 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.058912 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.059184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.060168 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.060168 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.060168 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.060627 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.060784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.060966 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.061274 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.065817 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.065817 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.065817 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.065817 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.065817 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.065817 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.065817 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.065817 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.066593 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.066593 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.066593 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.066593 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.066593 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.066593 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.066593 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.066593 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.067244 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.067244 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.067244 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.067468 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.067774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.068101 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.068414 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.068730 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.069062 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.069373 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.069687 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.070037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.070399 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.070796 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.071272 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.071587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.071899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.072210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.072521 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.072832 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.073141 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.073470 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.073829 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.074148 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.074461 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.074770 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.075097 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.075441 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.075779 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.076132 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.076454 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.076794 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.077133 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.077457 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.077792 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.078118 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.078449 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.078766 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.079085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.079412 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.079722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.080048 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.080382 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.080703 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.081024 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.081348 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.081667 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.082017 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.082352 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.082682 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.083004 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.083352 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.083702 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.084022 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.084351 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.084679 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.084994 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.085308 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.085621 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.086318 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.086669 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.086997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.087326 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.087647 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.087970 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.088289 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.088609 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.088931 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.089279 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.089603 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.089949 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.090079 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:19:37.090512 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.090592 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:19:37.090673 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.090865 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:19:37.090972 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.091195 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.091309 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:19:37.091460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:19:37.091561 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.091810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.091919 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.092146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.092311 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.092482 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.092638 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.092818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.092974 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.093147 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.093327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.093480 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.093635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.093834 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.093988 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.094155 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.094304 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.094451 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.094608 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.094767 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.094932 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.095093 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.095241 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.095399 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.095555 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-13-iscsi {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.095710 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.095870 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.096025 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.096180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.096336 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.096491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.096639 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.096795 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.096950 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.097108 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.097255 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.097408 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.097566 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.097723 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.097917 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.098074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.098247 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.098422 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.098582 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.098730 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.098896 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.099045 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.099203 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.100131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.100307 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.100465 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.100623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.100780 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.100928 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.101093 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.101269 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.101427 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.102192 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.102357 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.102512 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.102761 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.102916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.103065 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.103221 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-13-iscsi {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.103369 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.103525 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.103673 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.103827 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.103977 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.104124 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.104282 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.104443 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.104592 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.104748 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.104895 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.105050 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.105206 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.105361 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.105517 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.105665 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.105841 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.105994 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.106154 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.106313 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.106468 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.106615 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.106773 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.106922 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.107083 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.107231 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.107385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.107538 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.107697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.107844 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.108002 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.108160 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.108327 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.108475 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.108630 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.108871 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.109029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.109177 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.109323 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.109490 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.110357 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.110537 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.110696 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.110845 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.111019 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.111175 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.111331 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.111489 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.111657 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.111813 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.111970 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.112118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.112340 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.112489 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.112653 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.112916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.113084 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.113240 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.113397 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.113554 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.113709 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.113937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.114085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.114234 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.114392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.114550 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.114698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.114852 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.115000 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.115163 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.115319 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.115476 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.115624 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.115771 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.115924 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.116083 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.116241 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.116399 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.116554 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.116703 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.116850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.116997 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.117294 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.118057 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.118214 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.118381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.118601 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.118758 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.118921 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.119070 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.119070 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.119359 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.119515 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.119662 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.120949 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.120949 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.120949 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.121405 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.121554 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.121710 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.121895 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.122054 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.122210 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.122420 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.122420 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.122725 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.122725 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.123149 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.123302 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.123449 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.123606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.123784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.123936 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.124084 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.124244 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.124401 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.124555 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.124717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.124876 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.125033 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.125200 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.125356 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.125512 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.125674 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.125860 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.126023 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.126179 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.126328 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.126483 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.126640 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.126807 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.127085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.127247 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.127414 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.127579 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.127728 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.127884 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.128232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.128397 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.128555 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.128712 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.128861 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.129015 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.129164 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.129310 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.129475 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.129636 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.129804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.129976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.130618 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.130968 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.131126 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.131288 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.131437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.131584 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.131780 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.131940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.132098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.132256 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.132464 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.132634 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.132866 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.133113 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.133384 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.133549 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.133705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.133938 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.134099 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.134254 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.134409 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.134564 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.134732 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.134898 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.135046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.135210 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.135366 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.135512 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.135659 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.135815 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.136006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.136168 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.136319 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.136465 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.136620 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.136787 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.136934 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.137106 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.137338 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.137493 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.137650 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.137829 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.137984 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.138132 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.138288 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.138435 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.138592 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.138748 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.138914 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.139071 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.139227 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.139375 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.139621 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.139780 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.139994 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.140155 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.140798 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.141210 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.141382 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.141533 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:19:37.141694 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.141868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.142017 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.142176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.142325 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.142539 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.142692 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.142840 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.142987 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.143144 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.143294 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.143548 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.143717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.143894 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.144044 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.144201 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.144350 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.144497 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.144645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.144798 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.144960 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.145107 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.145255 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.145401 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.145401 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.145706 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.145959 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.146110 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.146265 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.146412 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.146567 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.146723 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.146880 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.147035 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.147184 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.147357 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.147603 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.147767 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.147942 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.148100 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.148248 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.148444 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.148660 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.148821 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.148969 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.149117 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.149263 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.149420 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.149576 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.149724 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.149898 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.150206 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.150383 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.151106 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.151518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.151680 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.151838 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.151988 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.151988 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.152278 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.152434 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.152637 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.152800 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.152949 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.153124 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.153281 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.153437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.153712 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.153889 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.154050 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.154214 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.154371 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.154519 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.154677 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.154832 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.154987 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.155163 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.155312 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.155459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.155623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.155777 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.155932 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.156096 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.156096 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.156389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.156550 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.156719 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.156883 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.157046 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.157221 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.157377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.157530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.157848 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.158023 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.158188 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.158351 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.158505 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.158666 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.158827 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.158991 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.159154 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.159309 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.159481 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.159644 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.159811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.159965 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.160119 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.160271 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.160433 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.160587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.161270 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.161453 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.161890 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.162065 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.162221 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.162395 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.162561 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.162780 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.162949 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.163119 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.163282 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.163436 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.163607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.163875 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.164563 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.164733 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.164889 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.165064 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.165233 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.165397 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.165563 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.165726 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.166027 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.166194 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.166349 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.166510 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.166665 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.166827 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.166981 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.167156 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.167333 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.167495 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.167659 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.167838 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.168095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.168267 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.168423 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.168585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.168740 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.168903 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.169066 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.169229 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.169398 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.169571 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.169725 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.169906 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.170079 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.170242 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.170404 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.170559 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.170712 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.170893 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.171517 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.171690 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.172109 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.172271 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.172447 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.172610 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.172907 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.173070 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.173231 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.173394 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.173562 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.173721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.174058 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.174228 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.174393 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.174547 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.174547 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.174875 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.175038 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.175192 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.175354 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.175507 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.175660 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.175832 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.175994 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.176155 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.176309 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.176475 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.176638 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.176816 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.176971 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.177132 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.177309 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.177472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.177659 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.177975 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.178247 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.178415 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.178631 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.178795 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.178959 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.179114 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.179281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.179435 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.180462 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.180462 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.180765 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.180765 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.181297 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.181297 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.182001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.182001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.182524 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.182692 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.182911 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.183081 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.183236 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.183392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.183562 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.183721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.183875 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.184058 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.184298 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.184467 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.184622 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.184784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.184958 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.185127 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.185290 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.185452 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.185608 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.185791 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.185965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.186132 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.186296 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.186452 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.186607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.186761 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.186935 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.187098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.187253 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.187407 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.187562 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.187716 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.187878 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.188115 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.188394 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.188557 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.188721 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.188876 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.189041 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.189209 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.189371 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.189527 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.189683 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.189900 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.190067 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.190230 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.190386 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.190539 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.190701 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.190866 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.191033 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.191197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.191502 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.192069 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.192236 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.192666 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.192829 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.193047 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.193215 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.193371 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.193371 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.193700 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.194282 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.194547 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.194709 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.194878 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.195035 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.195209 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.195399 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.195554 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.195717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.196018 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.196183 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.196354 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.196518 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.196673 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.196835 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.196991 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.197458 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.197624 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.197800 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.197972 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.198139 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.198294 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.198581 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.198751 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.198908 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.199063 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.199229 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.199383 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.199565 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.199730 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.199894 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.200048 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.200204 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.200357 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.200357 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.200666 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.200821 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.200974 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.201136 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.201305 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.201490 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.202138 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.202316 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.202481 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.202890 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.203158 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.203323 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.203493 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.203662 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.203816 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.203970 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.204139 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.204293 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.204457 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.204737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.204906 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.205062 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.205227 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.205390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.205546 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.205714 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.205952 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.206119 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.206274 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.206437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.206592 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.206746 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.206910 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.207073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.207238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.207401 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.207565 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.207727 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.207882 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.208045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.208199 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.208361 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.208533 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.208774 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.208955 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.209121 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.209277 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.209438 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.209603 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.209787 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.209967 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.210131 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.210131 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.210425 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.210587 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.210750 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.211618 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.211880 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.212429 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.212541 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.212631 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.212726 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.212839 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.213257 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.213375 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.213497 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.213619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.213734 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.213917 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.214055 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.214170 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.214170 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.214382 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.214503 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.214618 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.214749 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.214965 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.215093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.215221 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.215345 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.215468 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.215468 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.215680 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.215793 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.215915 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.216038 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.216151 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.216264 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.216264 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.216473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.216585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.216707 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.216822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.216944 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.217059 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.217172 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.217298 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.217412 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.217524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.217644 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.217787 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.217925 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.218067 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.218201 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.218323 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.218437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.218562 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.218686 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.218921 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.219043 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.219166 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.219290 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.219412 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.219527 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.219649 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.219763 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.219885 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.220013 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.220128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.220248 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.220363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.220475 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.220594 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.220718 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.220833 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.220945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.221057 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.221170 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.221170 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.221393 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.221393 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.221621 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.221621 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.221925 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.222063 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.222207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.222707 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.222831 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.222945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.223084 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.223471 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.223602 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.223725 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.223840 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.223969 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.224096 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.224096 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.224318 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.224318 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.224318 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.224318 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.224318 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.224827 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.224959 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.225171 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.225297 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.225413 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.225540 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.225655 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.225864 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.225994 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.226113 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.226226 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.226353 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.226519 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.227308 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.227308 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.227627 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.227627 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.227873 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.227988 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.228101 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.228214 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.228407 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.228528 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.228696 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.228835 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.229076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.229076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.229315 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.229438 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.229554 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.229554 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.229785 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.229924 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.230097 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.230267 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.230432 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.230432 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.230794 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.230951 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.231106 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.231288 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.231443 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.231605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.231767 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.231965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.232140 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.232307 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.232854 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.233020 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.233184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.233369 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.233865 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.234046 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.234206 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.234361 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.234524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.234686 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.234851 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.235018 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.235198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.235444 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.235611 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.235777 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.235947 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.236103 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.236258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.236412 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.236579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.236734 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.236899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.237054 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.237228 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.237384 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.237538 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.237706 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.237706 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.238048 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.238212 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.238368 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.238524 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.238693 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.238856 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.239044 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.239349 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.239524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.239687 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.239841 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.239997 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.240158 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.240312 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.240479 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.240634 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.240788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.240788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.241098 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.241262 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.241443 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.241600 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.241792 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.241966 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.241966 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.242480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.243222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.243402 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.243615 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.244025 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.244206 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.244378 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.244555 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.244712 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.244875 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.245031 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.245187 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.245356 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.245897 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.246077 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.246241 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.246406 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.246572 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.246727 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.246900 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.247056 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.247210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.247210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.247603 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.247761 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.247923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.248080 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.248251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.248407 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.248576 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.248740 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.248903 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.249083 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.249246 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.249516 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.249693 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.249888 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.250046 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.250218 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.250504 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.250690 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.250851 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.251015 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.251170 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.251336 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.251490 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.251654 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.251809 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.251964 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.252126 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.252126 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.252421 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.252586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.252748 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.253200 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.253454 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.253616 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.253918 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.254314 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.254485 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.254655 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.254812 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.254967 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.255132 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.255288 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.255454 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.255629 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.255876 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.256044 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.256285 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.256460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.256623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.256787 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.256943 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.257106 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.257276 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.257445 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.257603 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.257808 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.257974 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.258130 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.258447 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.258616 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.258885 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.259059 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.259223 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.259388 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.259663 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.259826 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.259826 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.260132 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.260302 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.260502 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.260659 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.260822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.260999 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.261157 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.261319 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.261496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.261496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.261864 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.262028 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.262183 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.262357 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.262522 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.262685 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.262849 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.263026 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.263498 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.263824 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.263989 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.264167 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.264572 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.265333 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.265498 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.265655 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.265828 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.266111 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.266290 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.266447 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.266622 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.266779 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.266943 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.267099 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.267266 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.267430 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.267585 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.267740 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.267894 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.268049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.268220 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.268378 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.268532 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.268699 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.268854 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.269007 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.269176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.269340 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.269508 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.269690 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.269998 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.270181 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.270347 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.270506 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.270660 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.270815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.270815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.271145 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.271301 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.271457 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.271620 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.271774 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.271935 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.272099 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.272257 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.272419 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.272711 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.272880 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.273056 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.273224 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.274414 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.274606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.274998 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.275175 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.275342 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.275506 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.275670 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.275826 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.275980 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.276254 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.276432 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.276607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.276773 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.276936 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.277137 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.277302 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.277473 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.277649 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.277649 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.278162 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.278512 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.278741 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.278901 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.279056 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.279224 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.279389 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.279546 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.279711 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.279868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.280144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.280144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.280584 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.280749 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.280916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.281073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.281378 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.281527 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.281628 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.281704 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.281815 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.281895 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.281968 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.282063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.282151 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.282246 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.282333 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.282427 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.282513 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.282607 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.282694 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.282794 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.282881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.282976 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.283063 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.283156 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.283250 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.283345 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.283432 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.283517 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.283602 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.283695 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.283781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.283876 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.283971 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.284085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.284521 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.284667 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.284769 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.284857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.285040 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.285141 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.285229 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.285316 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.285416 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.285511 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.285599 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.285684 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.285949 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.286051 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.286159 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.286272 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.286368 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.286456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.286541 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.286633 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.286730 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.286826 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.286921 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.287016 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.287103 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.287274 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.287372 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.287459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.287551 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.287638 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.287731 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.287831 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.287919 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.288011 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.288098 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.288191 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.288277 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.288372 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.288467 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.288560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.288647 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.288741 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.288842 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.288936 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.289105 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.289736 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.289871 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.289991 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.290394 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.290508 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.290596 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.290690 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.290785 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.290880 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.290980 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.291075 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.291163 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.291297 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.291424 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.291554 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.291651 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.291745 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.291839 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.291926 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.292012 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.292012 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.292187 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.292187 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.292366 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.292464 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.292559 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.292654 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.292741 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.292835 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.292921 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.293014 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.293100 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.293198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.293292 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.293379 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.293474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.293560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.293654 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.293741 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.293896 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.293999 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.294098 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.294185 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.294302 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.294660 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.294805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.294910 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.294910 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.295078 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.295177 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.295312 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.295415 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.295510 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.295596 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.295681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.295780 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.295867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.295951 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.296107 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.296211 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.296308 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.296403 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.296497 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.296583 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.296668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.296752 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.296846 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.296940 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.297026 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.297119 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.297214 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.297307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.297307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.297474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.297560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.297645 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.297737 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.297899 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.297990 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.298067 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.298679 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.298777 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.298863 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.298960 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.299045 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.299126 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.299200 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.299515 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.299605 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.299701 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.299797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.299932 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.300048 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.300048 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.300277 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.300529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.300863 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.300954 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.300954 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.301120 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.301220 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.301220 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.301394 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.301481 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.301567 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.301659 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.301771 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.301874 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.301962 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.302047 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.302138 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.302224 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.302318 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.302412 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.302506 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.302602 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.302688 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.302782 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.302869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.302962 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.303048 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.303140 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.303226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.303322 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.303416 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.303511 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.303598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.303693 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.303788 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.303876 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.303970 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.304053 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.304139 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.304223 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.304316 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.304403 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.304776 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.304923 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.305060 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.305159 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.305261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.305350 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.305485 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.305580 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.305674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.305802 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.305900 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.305977 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.306057 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.306131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.306212 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.306296 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.306378 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.306452 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.306452 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:19:37.306658 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.306658 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.306658 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.306658 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.306658 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.306658 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.306658 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.306658 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.307377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.307377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.307577 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.307950 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.308298 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.308660 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.309004 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.309341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.309688 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.310053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.310657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.311027 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.311369 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.311717 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.312065 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.312404 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.312732 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.313075 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.313399 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.314146 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.314868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.315373 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.315763 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.316091 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.316429 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.316758 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.317083 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.317410 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.317732 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.318263 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.318637 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.318963 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.319287 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.319652 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.319983 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.320333 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.320705 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.321033 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.321360 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.321724 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.322229 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.322461 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.322835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.323157 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.323478 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.323851 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.324194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.324516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.324834 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.325167 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.325595 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.325962 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.326296 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.326623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.326990 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.327321 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.327913 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.328269 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.328609 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.328963 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.329311 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.329632 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.329979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.330304 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.330647 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.330973 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.331298 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.331621 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.331945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.332268 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.332590 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.332912 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.333234 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.333556 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.333902 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.334222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.334542 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.334860 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.335182 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.335510 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.336388 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.336891 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.337260 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.337641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.338001 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.338327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.338651 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.338972 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.339296 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.339628 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.339974 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.340302 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.340621 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.341066 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.341388 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.341718 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.342072 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.342394 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.342730 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.343067 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.343390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.343724 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.344045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.344388 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.344743 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.345086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.345425 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.345743 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.346263 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.347261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.347261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.347261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.347757 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.347918 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.348203 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.348523 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.348840 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.349155 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.350173 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.350173 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.350173 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.351401 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.352628 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.352940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.353219 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.353587 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.353914 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.354401 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.354601 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.354900 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.355307 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.355633 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.355951 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.356311 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.356672 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.357009 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.357352 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.357686 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.358053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.358380 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.358723 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.359078 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.359397 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.359725 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.360072 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.360396 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.360723 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.361055 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.361379 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.361707 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.362233 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.362536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.362876 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.363200 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.363542 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.363878 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.364210 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.364314 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO dbcounter [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] Registered counter for database nova_api Aug 01 14:19:37.364539 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.364866 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.365208 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.365535 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.365885 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.366208 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.366538 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.366862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.367798 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.368213 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.368543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.368881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.369215 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.369559 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.369947 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.370276 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.370617 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.371220 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.371584 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.371915 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.373800 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.373800 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.373800 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.373800 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.373800 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:19:37.373800 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:19:37.386992 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_db.sqlalchemy.engines [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118246) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:19:37.394179 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writer thread running {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:19:37.439408 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO dbcounter [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] Registered counter for database nova_api Aug 01 14:19:37.451921 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.context [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2f65a740-7946-42c2-9ae7-26876e964053(cell1) {{(pid=118246) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 14:19:37.456088 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:37.457718 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:37.459286 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:37.463866 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:37.463866 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO dbcounter [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] Registered counter for database nova_cell0 Aug 01 14:19:37.469791 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_db.sqlalchemy.engines [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118247) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:19:37.469908 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO dbcounter [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] Registered counter for database nova_cell1 Aug 01 14:19:37.474781 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_db.sqlalchemy.engines [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118246) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:19:37.476711 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writer thread running {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:19:37.480245 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writer thread running {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:19:37.540129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.context [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2f65a740-7946-42c2-9ae7-26876e964053(cell1) {{(pid=118247) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 14:19:37.544593 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:37.546375 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:37.547203 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:37.549253 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:37.551361 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO dbcounter [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] Registered counter for database nova_cell0 Aug 01 14:19:37.556424 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO dbcounter [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] Registered counter for database nova_cell1 Aug 01 14:19:37.564845 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_db.sqlalchemy.engines [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118247) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:19:37.568079 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_db.sqlalchemy.engines [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118247) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:19:37.577482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writer thread running {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:19:37.578080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writer thread running {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:19:37.625739 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_db.sqlalchemy.engines [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118246) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:19:37.633822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writer thread running {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:19:37.648196 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO dbcounter [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] Registered counter for database nova_cell0 Aug 01 14:19:37.656094 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_db.sqlalchemy.engines [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118246) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:19:37.668564 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writer thread running {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:19:37.736589 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO dbcounter [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] Registered counter for database nova_cell0 Aug 01 14:19:37.744833 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_db.sqlalchemy.engines [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118247) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:19:37.749879 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writer thread running {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:19:37.997045 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: WARNING keystonemiddleware.auth_token [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:19:38.004493 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: WARNING keystonemiddleware.auth_token [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:19:38.075917 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: WARNING keystonemiddleware.auth_token [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:19:38.083281 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: WARNING keystonemiddleware.auth_token [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:19:38.353890 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: WARNING keystonemiddleware.auth_token [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:19:38.360354 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: WARNING keystonemiddleware.auth_token [None req-6294027b-4c45-4b8d-ac42-e394830ec509 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:19:38.365939 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556f9e0c69c0 pid: 118246 (default app) Aug 01 14:19:38.443438 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: WARNING keystonemiddleware.auth_token [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:19:38.450756 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: WARNING keystonemiddleware.auth_token [None req-c40c8d53-11c4-4cd4-9ffd-d3027e41db89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:19:38.456225 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556f9e0c69c0 pid: 118247 (default app) Aug 01 14:20:22.525458 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=3 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:22.527075 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=3 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:22.528021 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=3 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:22.528950 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=3 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:23.971788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c5432718-642c-4d27-8829-5056df7db45a tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Action: 'create', calling method: .version_select at 0x7fb255861ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-616962322"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:26.967369 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c5432718-642c-4d27-8829-5056df7db45a tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.451399 Aug 01 14:20:26.977641 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1155 bytes} [Mon Aug 1 14:20:22 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4454 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 14:20:26.991328 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=3 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:26.994228 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=3 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:26.996935 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=3 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:26.998870 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=3 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:27.403414 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0b488f69-d435-4a30-9a6e-7847c80debbc tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb2558d3c10>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:28.364387 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0b488f69-d435-4a30-9a6e-7847c80debbc tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91" status: 200 len: 344 microversion: 2.1 time: 1.373972 Aug 01 14:20:28.364387 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 1/2] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:26 2022] GET /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91 => generated 344 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:29.374155 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d214e85b-f51d-47bf-8a90-5c7a2939bf95 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb2556e3d30>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:29.539064 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d214e85b-f51d-47bf-8a90-5c7a2939bf95 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91" status: 200 len: 345 microversion: 2.1 time: 0.170004 Aug 01 14:20:29.540450 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:29 2022] GET /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91 => generated 345 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:29.557929 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-94b98cd5-ae36-41ce-96b5-3954fe679a22 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Action: 'create', calling method: .version_select at 0x7fb25571bd30>, body: {"snapshot": {"volume_id": "c3319888-9757-415d-afd7-57c41227ad91", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1854922701"}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:30.472291 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-94b98cd5-ae36-41ce-96b5-3954fe679a22 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.919737 Aug 01 14:20:30.472987 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 2/4] 10.222.0.49 () {60 vars in 1162 bytes} [Mon Aug 1 14:20:29 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:30.484722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8b9c3e63-11e1-48e5-9881-5e4a33fb5b24 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb2556f5430>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:30.641430 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8b9c3e63-11e1-48e5-9881-5e4a33fb5b24 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee" status: 200 len: 287 microversion: 2.1 time: 0.160809 Aug 01 14:20:30.642092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 3/5] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Aug 1 14:20:30 2022] GET /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:30.653709 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-9f6fb3b9-d6aa-4550-bcf1-cdca984f35e0 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb2556dcb80>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:31.007330 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-9f6fb3b9-d6aa-4550-bcf1-cdca984f35e0 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.356685 Aug 01 14:20:31.007932 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 3/6] 10.222.0.49 () {58 vars in 1140 bytes} [Mon Aug 1 14:20:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:31.020468 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e9e14ee5-9f95-496e-82d6-fc9b490d6d08 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb2556f5b80>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:31.384788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e9e14ee5-9f95-496e-82d6-fc9b490d6d08 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee" status: 200 len: 287 microversion: 2.1 time: 0.368582 Aug 01 14:20:31.385567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Aug 1 14:20:31 2022] GET /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee => generated 287 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:20:32.397133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c9411a24-8682-4a3c-93b6-75085a544b0f tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb2556f2d30>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:32.532311 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c9411a24-8682-4a3c-93b6-75085a544b0f tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee" status: 200 len: 287 microversion: 2.1 time: 0.138933 Aug 01 14:20:32.533317 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Aug 1 14:20:32 2022] GET /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee => generated 287 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:33.548509 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3151ee9b-f4e8-41d4-80e2-ec3f9a5a6547 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb2556e3d30>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:33.604861 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3151ee9b-f4e8-41d4-80e2-ec3f9a5a6547 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee" status: 200 len: 287 microversion: 2.1 time: 0.063814 Aug 01 14:20:33.606216 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 5/9] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Aug 1 14:20:33 2022] GET /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:34.617133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6cfb07eb-6db4-406c-b0f4-3258fc6caaa6 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb2556f2a60>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:34.688437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-6cfb07eb-6db4-406c-b0f4-3258fc6caaa6 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee" status: 200 len: 288 microversion: 2.1 time: 0.075258 Aug 01 14:20:34.695516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 5/10] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Aug 1 14:20:34 2022] GET /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee => generated 288 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:34.702792 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5318c432-129b-42f1-af5c-7b74300828c0 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb2556f5a60>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:34.918888 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5318c432-129b-42f1-af5c-7b74300828c0 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee" status: 202 len: 0 microversion: 2.1 time: 0.221989 Aug 01 14:20:34.919452 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 6/11] 10.222.0.49 () {58 vars in 1254 bytes} [Mon Aug 1 14:20:34 2022] DELETE /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:20:34.929901 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1ba64e53-7567-408a-8620-df509f14a292 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb2556f24c0>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:35.007864 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1ba64e53-7567-408a-8620-df509f14a292 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee" status: 200 len: 287 microversion: 2.1 time: 0.082888 Aug 01 14:20:35.009124 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Aug 1 14:20:34 2022] GET /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:36.020811 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c5bc467b-1545-4163-ab13-045d715631e7 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb2556f5310>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:36.092679 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-c5bc467b-1545-4163-ab13-045d715631e7 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] HTTP exception thrown: Snapshot 45b716e7-c64e-4404-8b90-80f08044daee could not be found. Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c5bc467b-1545-4163-ab13-045d715631e7 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Request method failure captured: Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee HTTP/1.1 Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-EmvcQK_UavI18UiCDU5LMegm2IRKzaON1RDKV0ePcT-x-LvZIjQE3pWG4ARO5Zvt3vt3_gt5kle2eu5pcA0aaH8YgAMWbmu8UdzQ-xr8Vd9x6UanGR7V6dF3y5XmX75L_NYypJqCuOi1IbwcnrTlgeLpLPmveB-dsFBZgTEhA9GQo Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: ebe0bff033bf40c3a5247c2e7ff24ce5 Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1978887123 Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:20:36.098587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:20:36.100029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebe0bff033bf40c3a5247c2e7ff24ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebe0bff033bf40c3a5247c2e7ff24ce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebe0bff033bf40c3a5247c2e7ff24ce5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebe0bff033bf40c3a5247c2e7ff24ce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:20:36.100029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1978887123 Aug 01 14:20:36.100029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: ebe0bff033bf40c3a5247c2e7ff24ce5 Aug 01 14:20:36.100029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1978887123 Aug 01 14:20:36.100029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-VolumesSnapshotsTestJSON-1978887123-project Aug 01 14:20:36.100029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:20:36.100029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:20:36.100029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: b668d9d211e44591ab2f862fef68817e Aug 01 14:20:36.100029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1978887123-project Aug 01 14:20:36.100029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: Aug 01 14:20:36.100029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Snapshot 45b716e7-c64e-4404-8b90-80f08044daee could not be found. Aug 01 14:20:36.100029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': '45b716e7-c64e-4404-8b90-80f08044daee'} Aug 01 14:20:36.100029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 45b716e7-c64e-4404-8b90-80f08044daee could not be found. (HTTP 404) (Request-ID: req-f829ac7a-574f-4811-b019-a3d2d3e4b244) Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:36.101534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:20:36.103207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 45b716e7-c64e-4404-8b90-80f08044daee could not be found. Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 01 14:20:36.105198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:20:36.107524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 45b716e7-c64e-4404-8b90-80f08044daee could not be found. Aug 01 14:20:36.107524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:36.107524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:36.107524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:36.107524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:36.107524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:36.107524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:36.107524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:20:36.107524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:20:36.107524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 45b716e7-c64e-4404-8b90-80f08044daee could not be found. Aug 01 14:20:36.107524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:36.107524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c5bc467b-1545-4163-ab13-045d715631e7 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Returning 404 to user: Snapshot 45b716e7-c64e-4404-8b90-80f08044daee could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:20:36.114350 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c5bc467b-1545-4163-ab13-045d715631e7 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee" status: 404 len: 111 microversion: 2.1 time: 0.088824 Aug 01 14:20:36.114350 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Aug 1 14:20:36 2022] GET /compute/v2.1/os-snapshots/45b716e7-c64e-4404-8b90-80f08044daee => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:20:36.126878 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e93f1c67-3653-4378-b234-d2dfcaeb1377 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb2556dc9d0>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:36.486630 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e93f1c67-3653-4378-b234-d2dfcaeb1377 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91" status: 202 len: 0 microversion: 2.1 time: 0.369925 Aug 01 14:20:36.488558 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 7/14] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Aug 1 14:20:36 2022] DELETE /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:20:36.500378 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-531139ab-bbf1-4f89-8a2f-8090c4a70941 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb25565d550>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:36.668458 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-531139ab-bbf1-4f89-8a2f-8090c4a70941 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91" status: 200 len: 344 microversion: 2.1 time: 0.174896 Aug 01 14:20:36.670874 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 8/15] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:36 2022] GET /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:20:37.698185 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e624a5c1-e700-4d6e-820e-14a6f483dc1b tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb25565dc10>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:37.816738 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e624a5c1-e700-4d6e-820e-14a6f483dc1b tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91" status: 200 len: 344 microversion: 2.1 time: 0.130146 Aug 01 14:20:37.825819 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 9/16] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:37 2022] GET /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:20:38.153413 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c598efe4-1794-44d5-a314-a118708291c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1592318370", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452", "networks": [{"uuid": "340879ca-bf79-4082-8b74-2ce45355f6f6"}]}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:38.383952 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.network.neutron [None req-c598efe4-1794-44d5-a314-a118708291c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] validate_networks() for [('340879ca-bf79-4082-8b74-2ce45355f6f6', None, None, None, None, None)] {{(pid=118247) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:20:38.846821 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-bd2f7326-20d5-4cd1-bc5a-c6a7bf0adfee tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb25565daf0>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:39.094520 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-bd2f7326-20d5-4cd1-bc5a-c6a7bf0adfee tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91" status: 200 len: 344 microversion: 2.1 time: 0.264425 Aug 01 14:20:39.095792 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 10/17] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:38 2022] GET /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91 => generated 344 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:40.109811 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f59b9376-8999-4ffd-9d1a-d31ad96575b5 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb25565d430>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:40.163768 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-c598efe4-1794-44d5-a314-a118708291c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Flavor limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:20:40.166580 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-c598efe4-1794-44d5-a314-a118708291c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Image limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:20:40.167083 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-c598efe4-1794-44d5-a314-a118708291c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Flavor pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:20:40.167501 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-c598efe4-1794-44d5-a314-a118708291c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Image pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:20:40.168324 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-c598efe4-1794-44d5-a314-a118708291c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:20:40.203844 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c598efe4-1794-44d5-a314-a118708291c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:40.208716 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c598efe4-1794-44d5-a314-a118708291c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:40.210462 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c598efe4-1794-44d5-a314-a118708291c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:40.211014 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c598efe4-1794-44d5-a314-a118708291c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:40.238678 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-f59b9376-8999-4ffd-9d1a-d31ad96575b5 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] HTTP exception thrown: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f59b9376-8999-4ffd-9d1a-d31ad96575b5 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Request method failure captured: Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91 HTTP/1.1 Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-EmvcQK_UavI18UiCDU5LMegm2IRKzaON1RDKV0ePcT-x-LvZIjQE3pWG4ARO5Zvt3vt3_gt5kle2eu5pcA0aaH8YgAMWbmu8UdzQ-xr8Vd9x6UanGR7V6dF3y5XmX75L_NYypJqCuOi1IbwcnrTlgeLpLPmveB-dsFBZgTEhA9GQo Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: ebe0bff033bf40c3a5247c2e7ff24ce5 Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1978887123 Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:20:40.241743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:20:40.243284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebe0bff033bf40c3a5247c2e7ff24ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebe0bff033bf40c3a5247c2e7ff24ce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebe0bff033bf40c3a5247c2e7ff24ce5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebe0bff033bf40c3a5247c2e7ff24ce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:20:40.243284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1978887123 Aug 01 14:20:40.243284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: ebe0bff033bf40c3a5247c2e7ff24ce5 Aug 01 14:20:40.243284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1978887123 Aug 01 14:20:40.243284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-VolumesSnapshotsTestJSON-1978887123-project Aug 01 14:20:40.243284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:20:40.243284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:20:40.243284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: b668d9d211e44591ab2f862fef68817e Aug 01 14:20:40.243284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1978887123-project Aug 01 14:20:40.243284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: Aug 01 14:20:40.243284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. Aug 01 14:20:40.243284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': 'c3319888-9757-415d-afd7-57c41227ad91'} Aug 01 14:20:40.243284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. (HTTP 404) (Request-ID: req-f13c4221-42df-443c-9957-64e80162b1d6) Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:40.244388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:20:40.245822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 14:20:40.247529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:20:40.248623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. Aug 01 14:20:40.248623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.248623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:40.248623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.248623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:40.248623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:40.248623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:40.248623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:20:40.248623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:20:40.248623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. Aug 01 14:20:40.248623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.248623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f59b9376-8999-4ffd-9d1a-d31ad96575b5 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Returning 404 to user: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:20:40.249605 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f59b9376-8999-4ffd-9d1a-d31ad96575b5 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91" status: 404 len: 109 microversion: 2.1 time: 0.143821 Aug 01 14:20:40.260476 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 11/18] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:40 2022] GET /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91 => generated 109 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:20:40.281603 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-6b1d0df8-37cf-4b86-929a-f71193f60179 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb255861ee0>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:40.364918 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-c598efe4-1794-44d5-a314-a118708291c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Getting quotas for project f351a73d1a584b2e9f51c4a86dfff0e3. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:20:40.384047 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-c598efe4-1794-44d5-a314-a118708291c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Getting quotas for user ea98d747777d42a5a9192dd2c4746038 and project f351a73d1a584b2e9f51c4a86dfff0e3. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:20:40.396719 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-6b1d0df8-37cf-4b86-929a-f71193f60179 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] HTTP exception thrown: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-6b1d0df8-37cf-4b86-929a-f71193f60179 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Request method failure captured: Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: DELETE /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91 HTTP/1.1 Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-EmvcQK_UavI18UiCDU5LMegm2IRKzaON1RDKV0ePcT-x-LvZIjQE3pWG4ARO5Zvt3vt3_gt5kle2eu5pcA0aaH8YgAMWbmu8UdzQ-xr8Vd9x6UanGR7V6dF3y5XmX75L_NYypJqCuOi1IbwcnrTlgeLpLPmveB-dsFBZgTEhA9GQo Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: ebe0bff033bf40c3a5247c2e7ff24ce5 Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1978887123 Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:20:40.399614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:20:40.400784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebe0bff033bf40c3a5247c2e7ff24ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebe0bff033bf40c3a5247c2e7ff24ce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebe0bff033bf40c3a5247c2e7ff24ce5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebe0bff033bf40c3a5247c2e7ff24ce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:20:40.400784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1978887123 Aug 01 14:20:40.400784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: ebe0bff033bf40c3a5247c2e7ff24ce5 Aug 01 14:20:40.400784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1978887123 Aug 01 14:20:40.400784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-VolumesSnapshotsTestJSON-1978887123-project Aug 01 14:20:40.400784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:20:40.400784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:20:40.400784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: b668d9d211e44591ab2f862fef68817e Aug 01 14:20:40.400784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1978887123-project Aug 01 14:20:40.400784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: Aug 01 14:20:40.400784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. Aug 01 14:20:40.400784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': 'c3319888-9757-415d-afd7-57c41227ad91'} Aug 01 14:20:40.400784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. (HTTP 404) (Request-ID: req-b8af6cb9-f1c6-4c89-a631-a381a3b5eef5) Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:40.401790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:20:40.403046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 14:20:40.404073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:20:40.405098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. Aug 01 14:20:40.405098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.405098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:40.405098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.405098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:40.405098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:40.405098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:40.405098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:20:40.405098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:20:40.405098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. Aug 01 14:20:40.405098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.405098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-6b1d0df8-37cf-4b86-929a-f71193f60179 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Returning 404 to user: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:20:40.405098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-6b1d0df8-37cf-4b86-929a-f71193f60179 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91" status: 404 len: 109 microversion: 2.1 time: 0.139364 Aug 01 14:20:40.405098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 12/19] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Aug 1 14:20:40 2022] DELETE /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91 => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:20:40.445258 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c598efe4-1794-44d5-a314-a118708291c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Going to run 1 instances... {{(pid=118247) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:20:40.454346 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c598efe4-1794-44d5-a314-a118708291c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118247) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:20:40.622795 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e8b8f625-23e3-447e-8d20-69af9d1cffe1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Action: 'create', calling method: .version_select at 0x7fb25565d820>, body: {"keypair": {"name": "tempest-keypair-1107727446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFte0x71XgVLQ9QhNLKYPIW8fuSuatddxsjxHDDlWvNpg8RL74/qKn9qoqjHU5FlbyiYsVfCRqNj564UyLGaVyfFjkRQcaEAON7Ma7adQT3NRAn2xVlUGj0fKGsKtUdeMA=="}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:40.778745 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c598efe4-1794-44d5-a314-a118708291c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.288140 Aug 01 14:20:40.779485 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 8/20] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:20:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:20:40.785915 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-e8b8f625-23e3-447e-8d20-69af9d1cffe1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Getting quotas for project 6bcd2b3241464b25a20c9d559ed9a049. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:20:40.789726 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-321bc9ce-d240-4109-b667-a916f81696f5 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Calling method '.version_select at 0x7fb254df5940>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:40.817058 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-e8b8f625-23e3-447e-8d20-69af9d1cffe1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Getting quotas for user 14c4c1027d8a42c081d69fa821216675 and project 6bcd2b3241464b25a20c9d559ed9a049. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:20:40.965330 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-321bc9ce-d240-4109-b667-a916f81696f5 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] HTTP exception thrown: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-321bc9ce-d240-4109-b667-a916f81696f5 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Request method failure captured: Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91 HTTP/1.1 Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-EmvcQK_UavI18UiCDU5LMegm2IRKzaON1RDKV0ePcT-x-LvZIjQE3pWG4ARO5Zvt3vt3_gt5kle2eu5pcA0aaH8YgAMWbmu8UdzQ-xr8Vd9x6UanGR7V6dF3y5XmX75L_NYypJqCuOi1IbwcnrTlgeLpLPmveB-dsFBZgTEhA9GQo Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: ebe0bff033bf40c3a5247c2e7ff24ce5 Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1978887123 Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:20:40.969657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:20:40.970926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebe0bff033bf40c3a5247c2e7ff24ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ebe0bff033bf40c3a5247c2e7ff24ce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ebe0bff033bf40c3a5247c2e7ff24ce5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ebe0bff033bf40c3a5247c2e7ff24ce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:20:40.970926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1978887123 Aug 01 14:20:40.970926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: ebe0bff033bf40c3a5247c2e7ff24ce5 Aug 01 14:20:40.970926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1978887123 Aug 01 14:20:40.970926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-VolumesSnapshotsTestJSON-1978887123-project Aug 01 14:20:40.970926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:20:40.970926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:20:40.970926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: b668d9d211e44591ab2f862fef68817e Aug 01 14:20:40.970926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1978887123-project Aug 01 14:20:40.970926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: Aug 01 14:20:40.970926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. Aug 01 14:20:40.970926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': 'c3319888-9757-415d-afd7-57c41227ad91'} Aug 01 14:20:40.970926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. (HTTP 404) (Request-ID: req-27e3b3e2-5f9a-47b0-9906-170ab1002154) Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:40.971668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:20:40.972671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 14:20:40.974095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:20:40.975118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. Aug 01 14:20:40.975118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.975118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:40.975118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.975118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:40.975118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:40.975118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:40.975118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:20:40.975118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:20:40.975118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. Aug 01 14:20:40.975118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:20:40.978168 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-321bc9ce-d240-4109-b667-a916f81696f5 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] Returning 404 to user: Volume c3319888-9757-415d-afd7-57c41227ad91 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:20:40.979210 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-321bc9ce-d240-4109-b667-a916f81696f5 tempest-VolumesSnapshotsTestJSON-1978887123 tempest-VolumesSnapshotsTestJSON-1978887123-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91" status: 404 len: 109 microversion: 2.1 time: 0.198426 Aug 01 14:20:40.980187 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 9/21] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Aug 1 14:20:40 2022] GET /compute/v2.1/os-volumes/c3319888-9757-415d-afd7-57c41227ad91 => generated 109 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:20:41.098192 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e8b8f625-23e3-447e-8d20-69af9d1cffe1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.695412 Aug 01 14:20:41.099064 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 13/22] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Aug 1 14:20:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 697 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 14:20:41.106530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-95df531f-958a-4802-9f21-449b29057389 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:41.108720 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-95df531f-958a-4802-9f21-449b29057389 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:41.316562 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-95df531f-958a-4802-9f21-449b29057389 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:41.349501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-95df531f-958a-4802-9f21-449b29057389 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1215 microversion: 2.1 time: 0.244551 Aug 01 14:20:41.352620 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 14/23] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:41 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1215 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:41.960902 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3028aa69-b2a4-4023-829e-3e242a40804d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-388761016", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:42.087731 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.network.neutron [None req-3028aa69-b2a4-4023-829e-3e242a40804d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] validate_networks() for [('bf6cca88-8a12-4d78-b962-67bd78f418e2', None, None, None, None, None)] {{(pid=118247) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:20:42.693854 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b18c5016-2619-4c7c-8b0f-1ce48a0db117 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Action: 'create', calling method: .version_select at 0x7fb254df31f0>, body: {"keypair": {"name": "tempest-keypair-568684628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+UaGLzid5fns5irZ0Q02/tEts/nKqQgbdQ1Kxk4uNG+Btd/juswC/uXu5Kg723LD8YccwevCXihSMj7N2DkRMlRNkZbWw3XN4bt/IOZfXz3K/fPOQ/uTTiV7r5FNcpUw=="}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:42.751091 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-b18c5016-2619-4c7c-8b0f-1ce48a0db117 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Getting quotas for project 3f7ea2daaa864df7973b21d1d13ae47a. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:20:42.773484 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-b18c5016-2619-4c7c-8b0f-1ce48a0db117 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Getting quotas for user 47da4644803547869a303a039ee7a28c and project 3f7ea2daaa864df7973b21d1d13ae47a. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:20:42.941671 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b18c5016-2619-4c7c-8b0f-1ce48a0db117 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.803355 Aug 01 14:20:42.942335 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 15/24] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Aug 1 14:20:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:42.957648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e2536ac3-a453-40fa-b514-d2848a08c4f7 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:42.964416 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e2536ac3-a453-40fa-b514-d2848a08c4f7 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:43.045128 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-3028aa69-b2a4-4023-829e-3e242a40804d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Flavor limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:20:43.046656 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-3028aa69-b2a4-4023-829e-3e242a40804d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Image limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:20:43.047314 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-3028aa69-b2a4-4023-829e-3e242a40804d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Flavor pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:20:43.048036 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-3028aa69-b2a4-4023-829e-3e242a40804d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Image pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:20:43.055611 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-3028aa69-b2a4-4023-829e-3e242a40804d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:20:43.072999 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3028aa69-b2a4-4023-829e-3e242a40804d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:43.073826 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3028aa69-b2a4-4023-829e-3e242a40804d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:43.077119 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3028aa69-b2a4-4023-829e-3e242a40804d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:43.077965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3028aa69-b2a4-4023-829e-3e242a40804d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:43.135359 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e2536ac3-a453-40fa-b514-d2848a08c4f7 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:43.143490 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e2536ac3-a453-40fa-b514-d2848a08c4f7 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1215 microversion: 2.1 time: 0.192777 Aug 01 14:20:43.147118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-3028aa69-b2a4-4023-829e-3e242a40804d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Getting quotas for project c80bd4eb290541d8a713ea5ba60d0de4. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:20:43.147601 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 16/25] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:42 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1215 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:43.161984 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-3028aa69-b2a4-4023-829e-3e242a40804d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Getting quotas for user 6b46ac5a29594c41a83e70838b0a13c8 and project c80bd4eb290541d8a713ea5ba60d0de4. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:20:43.194422 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3028aa69-b2a4-4023-829e-3e242a40804d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Going to run 1 instances... {{(pid=118247) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:20:43.210173 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3028aa69-b2a4-4023-829e-3e242a40804d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118247) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:20:43.480702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3028aa69-b2a4-4023-829e-3e242a40804d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.494072 Aug 01 14:20:43.491862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 10/26] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:20:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:20:43.500486 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-efee81c6-872e-4fe9-ad56-fa80544a62dc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:43.501107 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-efee81c6-872e-4fe9-ad56-fa80544a62dc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:43.860029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-efee81c6-872e-4fe9-ad56-fa80544a62dc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:43.870427 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-efee81c6-872e-4fe9-ad56-fa80544a62dc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1221 microversion: 2.1 time: 0.373168 Aug 01 14:20:43.911428 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 17/27] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:43 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1221 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:44.134544 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a0606adf-203f-405b-9d8e-0dd82f8a928f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-773343164", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:44.204195 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8f7fe7ba-e8f8-44fb-acbb-7a3e6247658b tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:44.211841 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8f7fe7ba-e8f8-44fb-acbb-7a3e6247658b tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:44.311985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.network.neutron [None req-a0606adf-203f-405b-9d8e-0dd82f8a928f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] validate_networks() for [('bf6cca88-8a12-4d78-b962-67bd78f418e2', None, None, None, None, None)] {{(pid=118247) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:20:44.792944 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8f7fe7ba-e8f8-44fb-acbb-7a3e6247658b tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:44.811776 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8f7fe7ba-e8f8-44fb-acbb-7a3e6247658b tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1215 microversion: 2.1 time: 0.646042 Aug 01 14:20:44.820327 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 18/28] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:44 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1215 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:45.656644 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-a0606adf-203f-405b-9d8e-0dd82f8a928f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Flavor limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:20:45.657486 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-a0606adf-203f-405b-9d8e-0dd82f8a928f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Image limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:20:45.658441 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-a0606adf-203f-405b-9d8e-0dd82f8a928f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Flavor pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:20:45.659559 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-a0606adf-203f-405b-9d8e-0dd82f8a928f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Image pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:20:45.660153 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-a0606adf-203f-405b-9d8e-0dd82f8a928f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:20:45.707445 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a0606adf-203f-405b-9d8e-0dd82f8a928f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:45.714017 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a0606adf-203f-405b-9d8e-0dd82f8a928f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:45.720999 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a0606adf-203f-405b-9d8e-0dd82f8a928f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:45.728489 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a0606adf-203f-405b-9d8e-0dd82f8a928f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:45.805831 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-a0606adf-203f-405b-9d8e-0dd82f8a928f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Getting quotas for project c80bd4eb290541d8a713ea5ba60d0de4. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:20:45.827726 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-a0606adf-203f-405b-9d8e-0dd82f8a928f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Getting quotas for user 6b46ac5a29594c41a83e70838b0a13c8 and project c80bd4eb290541d8a713ea5ba60d0de4. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:20:45.847717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-99a970c3-dfec-466c-b883-9849a4cc55cb tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:45.849660 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-99a970c3-dfec-466c-b883-9849a4cc55cb tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:45.897132 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a0606adf-203f-405b-9d8e-0dd82f8a928f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Going to run 1 instances... {{(pid=118247) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:20:45.899480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a0606adf-203f-405b-9d8e-0dd82f8a928f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118247) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:20:46.005878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-99a970c3-dfec-466c-b883-9849a4cc55cb tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:46.020543 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-99a970c3-dfec-466c-b883-9849a4cc55cb tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1215 microversion: 2.1 time: 0.179925 Aug 01 14:20:46.027562 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 19/29] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:45 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1215 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:46.157886 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a0606adf-203f-405b-9d8e-0dd82f8a928f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.028389 Aug 01 14:20:46.171472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 11/30] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:20:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 2043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:20:46.183646 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ed43b896-3cb2-4c65-81e5-12edb782198a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:46.184284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ed43b896-3cb2-4c65-81e5-12edb782198a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:46.313581 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ed43b896-3cb2-4c65-81e5-12edb782198a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:46.322695 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ed43b896-3cb2-4c65-81e5-12edb782198a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1221 microversion: 2.1 time: 0.144063 Aug 01 14:20:46.324209 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 20/31] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:46 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1221 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:47.045590 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f579d4f7-416c-4dbc-a14a-6f1d3c3dbd09 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:47.047451 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f579d4f7-416c-4dbc-a14a-6f1d3c3dbd09 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:47.082272 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f579d4f7-416c-4dbc-a14a-6f1d3c3dbd09 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:47.083671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f579d4f7-416c-4dbc-a14a-6f1d3c3dbd09 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:47.085087 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f579d4f7-416c-4dbc-a14a-6f1d3c3dbd09 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:47.085559 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f579d4f7-416c-4dbc-a14a-6f1d3c3dbd09 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:47.346460 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f13f260a-2de4-45f9-9e3f-fc07142e47df tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:47.348203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f13f260a-2de4-45f9-9e3f-fc07142e47df tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:47.536484 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f13f260a-2de4-45f9-9e3f-fc07142e47df tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:47.560247 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f13f260a-2de4-45f9-9e3f-fc07142e47df tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1221 microversion: 2.1 time: 0.214959 Aug 01 14:20:47.562392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 21/32] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:47 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1221 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:47.653673 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f579d4f7-416c-4dbc-a14a-6f1d3c3dbd09 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:47.714343 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f579d4f7-416c-4dbc-a14a-6f1d3c3dbd09 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1219 microversion: 2.1 time: 0.672749 Aug 01 14:20:47.722899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-bb12cc8f-0478-40f9-8dd3-e4f2b815dada tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1007720409", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cbff8890-c84b-430f-a29c-0bb50c33b50e"}], "security_groups": [{"name": "tempest-securitygroup--590445882"}], "key_name": "tempest-keypair-1107727446", "user_data": "}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:47.730194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 12/33] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:47 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1219 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:48.169278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.network.neutron [None req-bb12cc8f-0478-40f9-8dd3-e4f2b815dada tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] validate_networks() for [('cbff8890-c84b-430f-a29c-0bb50c33b50e', None, None, None, None, None)] {{(pid=118246) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:20:48.588378 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d99b433a-7920-4398-b865-91eb6b30c71c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:48.589598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d99b433a-7920-4398-b865-91eb6b30c71c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:48.603676 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d99b433a-7920-4398-b865-91eb6b30c71c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:48.612761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d99b433a-7920-4398-b865-91eb6b30c71c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:48.614728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d99b433a-7920-4398-b865-91eb6b30c71c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:48.622240 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d99b433a-7920-4398-b865-91eb6b30c71c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:48.844534 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d99b433a-7920-4398-b865-91eb6b30c71c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:48.860992 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d99b433a-7920-4398-b865-91eb6b30c71c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1217 microversion: 2.1 time: 0.277427 Aug 01 14:20:48.865146 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 13/34] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:48 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1217 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:48.871425 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e0a96fe4-733e-4e3a-8da5-5c842030f0fd tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:48.872038 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e0a96fe4-733e-4e3a-8da5-5c842030f0fd tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:48.881889 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e0a96fe4-733e-4e3a-8da5-5c842030f0fd tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:48.882809 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e0a96fe4-733e-4e3a-8da5-5c842030f0fd tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:48.883118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e0a96fe4-733e-4e3a-8da5-5c842030f0fd tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:48.883546 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e0a96fe4-733e-4e3a-8da5-5c842030f0fd tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:49.026916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e0a96fe4-733e-4e3a-8da5-5c842030f0fd tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:49.042677 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e0a96fe4-733e-4e3a-8da5-5c842030f0fd tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1267 microversion: 2.1 time: 0.173919 Aug 01 14:20:49.054431 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 14/35] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:48 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:49.390822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-bb12cc8f-0478-40f9-8dd3-e4f2b815dada tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Flavor limits 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:20:49.391343 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-bb12cc8f-0478-40f9-8dd3-e4f2b815dada tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Image limits 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:20:49.391765 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-bb12cc8f-0478-40f9-8dd3-e4f2b815dada tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Flavor pref 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:20:49.392196 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-bb12cc8f-0478-40f9-8dd3-e4f2b815dada tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Image pref 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:20:49.392626 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-bb12cc8f-0478-40f9-8dd3-e4f2b815dada tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:20:49.418215 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bb12cc8f-0478-40f9-8dd3-e4f2b815dada tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:49.418692 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bb12cc8f-0478-40f9-8dd3-e4f2b815dada tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:49.423173 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bb12cc8f-0478-40f9-8dd3-e4f2b815dada tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:49.423617 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bb12cc8f-0478-40f9-8dd3-e4f2b815dada tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:49.464507 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-bb12cc8f-0478-40f9-8dd3-e4f2b815dada tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Getting quotas for project 6bcd2b3241464b25a20c9d559ed9a049. Resources: {'ram', 'cores', 'instances'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:20:49.473178 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-bb12cc8f-0478-40f9-8dd3-e4f2b815dada tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Getting quotas for user 14c4c1027d8a42c081d69fa821216675 and project 6bcd2b3241464b25a20c9d559ed9a049. Resources: {'ram', 'cores', 'instances'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:20:49.504206 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-bb12cc8f-0478-40f9-8dd3-e4f2b815dada tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Going to run 1 instances... {{(pid=118246) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:20:49.504206 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-bb12cc8f-0478-40f9-8dd3-e4f2b815dada tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118246) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:20:49.583515 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e91dc27c-75c1-49cf-a235-ab12fe93d1b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2126488036", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0fea80f7-2a2a-46a4-990b-9057ef4495f4"}], "security_groups": [{"name": "tempest-securitygroup--660739850"}], "key_name": "tempest-keypair-568684628", "user_data": "}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:49.823032 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-bb12cc8f-0478-40f9-8dd3-e4f2b815dada tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.105954 Aug 01 14:20:49.824078 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 22/36] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Aug 1 14:20:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 2108 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 01 14:20:49.848284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-9fd9bd5d-1586-4c78-a31a-9d8823f2afeb tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:49.852563 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-9fd9bd5d-1586-4c78-a31a-9d8823f2afeb tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:49.905559 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.network.neutron [None req-e91dc27c-75c1-49cf-a235-ab12fe93d1b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] validate_networks() for [('0fea80f7-2a2a-46a4-990b-9057ef4495f4', None, None, None, None, None)] {{(pid=118247) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:20:50.606501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-9fd9bd5d-1586-4c78-a31a-9d8823f2afeb tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:50.628196 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-9fd9bd5d-1586-4c78-a31a-9d8823f2afeb tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:50.639377 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-9fd9bd5d-1586-4c78-a31a-9d8823f2afeb tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:50.641958 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-9fd9bd5d-1586-4c78-a31a-9d8823f2afeb tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1282 microversion: 2.20 time: 0.810637 Aug 01 14:20:50.644788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 23/37] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:49 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1282 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:50.657766 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-480d600d-5c42-4f74-8e2f-ba8300f8f341 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:50.659838 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-480d600d-5c42-4f74-8e2f-ba8300f8f341 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:50.679571 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-480d600d-5c42-4f74-8e2f-ba8300f8f341 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:50.685818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-480d600d-5c42-4f74-8e2f-ba8300f8f341 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:50.686982 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-480d600d-5c42-4f74-8e2f-ba8300f8f341 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:50.689866 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-480d600d-5c42-4f74-8e2f-ba8300f8f341 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:51.180990 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-480d600d-5c42-4f74-8e2f-ba8300f8f341 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:51.203501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-480d600d-5c42-4f74-8e2f-ba8300f8f341 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1279 microversion: 2.1 time: 0.556637 Aug 01 14:20:51.204567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 24/38] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:50 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1279 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:51.219926 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-56b889b5-8c08-47db-98dd-e433d3a10d44 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:51.220629 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-56b889b5-8c08-47db-98dd-e433d3a10d44 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:51.230396 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-56b889b5-8c08-47db-98dd-e433d3a10d44 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:51.230979 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-56b889b5-8c08-47db-98dd-e433d3a10d44 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:51.231774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-56b889b5-8c08-47db-98dd-e433d3a10d44 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:51.232284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-56b889b5-8c08-47db-98dd-e433d3a10d44 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:51.338330 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-56b889b5-8c08-47db-98dd-e433d3a10d44 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:51.353037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-56b889b5-8c08-47db-98dd-e433d3a10d44 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1273 microversion: 2.1 time: 0.144200 Aug 01 14:20:51.354209 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 25/39] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:51 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:51.362014 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-e91dc27c-75c1-49cf-a235-ab12fe93d1b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Flavor limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:20:51.363255 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-e91dc27c-75c1-49cf-a235-ab12fe93d1b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Image limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:20:51.363889 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-e91dc27c-75c1-49cf-a235-ab12fe93d1b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Flavor pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:20:51.364456 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-e91dc27c-75c1-49cf-a235-ab12fe93d1b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Image pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:20:51.365022 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-e91dc27c-75c1-49cf-a235-ab12fe93d1b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:20:51.393958 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e91dc27c-75c1-49cf-a235-ab12fe93d1b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:51.394427 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e91dc27c-75c1-49cf-a235-ab12fe93d1b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:51.395238 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e91dc27c-75c1-49cf-a235-ab12fe93d1b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:51.397157 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e91dc27c-75c1-49cf-a235-ab12fe93d1b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:51.438835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-e91dc27c-75c1-49cf-a235-ab12fe93d1b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Getting quotas for project 3f7ea2daaa864df7973b21d1d13ae47a. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:20:51.450774 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-e91dc27c-75c1-49cf-a235-ab12fe93d1b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Getting quotas for user 47da4644803547869a303a039ee7a28c and project 3f7ea2daaa864df7973b21d1d13ae47a. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:20:51.478586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e91dc27c-75c1-49cf-a235-ab12fe93d1b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Going to run 1 instances... {{(pid=118247) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:20:51.481313 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e91dc27c-75c1-49cf-a235-ab12fe93d1b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118247) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:20:51.670370 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-53199a76-9506-4cca-b084-c5bba70bd73f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:51.671636 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-53199a76-9506-4cca-b084-c5bba70bd73f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:51.681573 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-53199a76-9506-4cca-b084-c5bba70bd73f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:51.682368 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-53199a76-9506-4cca-b084-c5bba70bd73f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:51.683703 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-53199a76-9506-4cca-b084-c5bba70bd73f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:51.684754 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-53199a76-9506-4cca-b084-c5bba70bd73f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:51.712360 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e91dc27c-75c1-49cf-a235-ab12fe93d1b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.133532 Aug 01 14:20:51.713478 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 15/40] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:20:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 2135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 14:20:51.730768 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-93a9fe97-6c56-403a-989c-daede82e47eb tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:51.734102 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-93a9fe97-6c56-403a-989c-daede82e47eb tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:51.895699 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-93a9fe97-6c56-403a-989c-daede82e47eb tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:51.918923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-93a9fe97-6c56-403a-989c-daede82e47eb tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1237 microversion: 2.1 time: 0.197948 Aug 01 14:20:51.938060 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 16/41] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:51 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1237 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:51.974353 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-53199a76-9506-4cca-b084-c5bba70bd73f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:51.994166 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-53199a76-9506-4cca-b084-c5bba70bd73f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:51.996380 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-53199a76-9506-4cca-b084-c5bba70bd73f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:52.011609 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-53199a76-9506-4cca-b084-c5bba70bd73f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1286 microversion: 2.20 time: 0.342678 Aug 01 14:20:52.014110 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 26/42] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:51 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1286 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:20:52.238339 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e052d52b-b66b-4b2d-979a-9e6281a65e07 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:52.238981 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e052d52b-b66b-4b2d-979a-9e6281a65e07 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:52.249959 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e052d52b-b66b-4b2d-979a-9e6281a65e07 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:52.250422 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e052d52b-b66b-4b2d-979a-9e6281a65e07 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:52.251227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e052d52b-b66b-4b2d-979a-9e6281a65e07 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:52.251679 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e052d52b-b66b-4b2d-979a-9e6281a65e07 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:52.382039 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-a11f0517-e8c2-4542-b221-70cf78408c48 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:52.382662 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-a11f0517-e8c2-4542-b221-70cf78408c48 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:52.403308 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a11f0517-e8c2-4542-b221-70cf78408c48 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:52.403783 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a11f0517-e8c2-4542-b221-70cf78408c48 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:52.410655 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a11f0517-e8c2-4542-b221-70cf78408c48 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:52.411184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a11f0517-e8c2-4542-b221-70cf78408c48 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:52.437033 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e052d52b-b66b-4b2d-979a-9e6281a65e07 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:52.449099 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e052d52b-b66b-4b2d-979a-9e6281a65e07 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1279 microversion: 2.1 time: 0.221440 Aug 01 14:20:52.449708 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 17/43] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:52 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1279 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:52.671870 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a11f0517-e8c2-4542-b221-70cf78408c48 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:52.692666 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-a11f0517-e8c2-4542-b221-70cf78408c48 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1273 microversion: 2.1 time: 0.313806 Aug 01 14:20:52.719514 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 27/44] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:52 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1273 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:52.949247 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-9dcdf5b7-79fd-4efd-8fd1-58c36f626547 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:52.955560 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-9dcdf5b7-79fd-4efd-8fd1-58c36f626547 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:53.044283 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-fc285a6e-9b82-4fa3-a962-b5ab357b347f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:53.045074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-fc285a6e-9b82-4fa3-a962-b5ab357b347f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:53.048074 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-9dcdf5b7-79fd-4efd-8fd1-58c36f626547 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:53.060163 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-9dcdf5b7-79fd-4efd-8fd1-58c36f626547 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1237 microversion: 2.1 time: 0.117933 Aug 01 14:20:53.061207 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 18/45] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:52 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1237 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:53.097260 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fc285a6e-9b82-4fa3-a962-b5ab357b347f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:53.099079 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fc285a6e-9b82-4fa3-a962-b5ab357b347f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:53.106064 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fc285a6e-9b82-4fa3-a962-b5ab357b347f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:53.106680 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fc285a6e-9b82-4fa3-a962-b5ab357b347f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:53.295290 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-fc285a6e-9b82-4fa3-a962-b5ab357b347f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:53.305158 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-fc285a6e-9b82-4fa3-a962-b5ab357b347f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:53.312284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-fc285a6e-9b82-4fa3-a962-b5ab357b347f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:53.314842 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-fc285a6e-9b82-4fa3-a962-b5ab357b347f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1334 microversion: 2.20 time: 0.278476 Aug 01 14:20:53.317588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 28/46] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:53 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1334 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:53.470980 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d643ff75-3b5b-4567-b840-cfbdc759977f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:53.471603 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d643ff75-3b5b-4567-b840-cfbdc759977f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:53.480474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d643ff75-3b5b-4567-b840-cfbdc759977f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:53.506285 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d643ff75-3b5b-4567-b840-cfbdc759977f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:53.508592 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d643ff75-3b5b-4567-b840-cfbdc759977f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:53.511328 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d643ff75-3b5b-4567-b840-cfbdc759977f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:53.718673 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-daf391ca-b5ea-4762-8092-517688d4af8c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:53.720238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-daf391ca-b5ea-4762-8092-517688d4af8c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:53.741922 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-daf391ca-b5ea-4762-8092-517688d4af8c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:53.743082 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-daf391ca-b5ea-4762-8092-517688d4af8c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:53.749176 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-daf391ca-b5ea-4762-8092-517688d4af8c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:53.750029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-daf391ca-b5ea-4762-8092-517688d4af8c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:53.804525 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d643ff75-3b5b-4567-b840-cfbdc759977f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:53.824590 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d643ff75-3b5b-4567-b840-cfbdc759977f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1279 microversion: 2.1 time: 0.357977 Aug 01 14:20:53.827480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 19/47] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:53 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1279 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:54.086672 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-34223ef0-d810-480f-9c05-a60482ae3dac tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:54.087572 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-34223ef0-d810-480f-9c05-a60482ae3dac tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:54.106221 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-34223ef0-d810-480f-9c05-a60482ae3dac tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.111241 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-34223ef0-d810-480f-9c05-a60482ae3dac tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:54.113329 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-34223ef0-d810-480f-9c05-a60482ae3dac tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.116088 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-34223ef0-d810-480f-9c05-a60482ae3dac tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:54.249097 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-daf391ca-b5ea-4762-8092-517688d4af8c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:54.261399 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-daf391ca-b5ea-4762-8092-517688d4af8c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.546006 Aug 01 14:20:54.262062 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 29/48] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:53 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:20:54.318299 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-34223ef0-d810-480f-9c05-a60482ae3dac tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:54.330359 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-34223ef0-d810-480f-9c05-a60482ae3dac tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1241 microversion: 2.1 time: 0.246463 Aug 01 14:20:54.331077 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 20/49] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:54 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1241 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:20:54.343556 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8405678e-2c1a-46ea-8ab0-a9639ae25918 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:54.346617 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8405678e-2c1a-46ea-8ab0-a9639ae25918 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:54.361962 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8405678e-2c1a-46ea-8ab0-a9639ae25918 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.363908 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8405678e-2c1a-46ea-8ab0-a9639ae25918 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:54.363908 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8405678e-2c1a-46ea-8ab0-a9639ae25918 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.369390 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8405678e-2c1a-46ea-8ab0-a9639ae25918 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:54.602295 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8405678e-2c1a-46ea-8ab0-a9639ae25918 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:54.611470 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8405678e-2c1a-46ea-8ab0-a9639ae25918 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:54.616570 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8405678e-2c1a-46ea-8ab0-a9639ae25918 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:54.629802 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8405678e-2c1a-46ea-8ab0-a9639ae25918 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1352 microversion: 2.20 time: 0.291043 Aug 01 14:20:54.630968 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 30/50] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:54 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1352 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:54.849572 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-315541a6-a283-41aa-861e-923960390951 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:54.850773 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-315541a6-a283-41aa-861e-923960390951 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:54.860337 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-315541a6-a283-41aa-861e-923960390951 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.866353 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-315541a6-a283-41aa-861e-923960390951 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:54.867666 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-315541a6-a283-41aa-861e-923960390951 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.868363 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-315541a6-a283-41aa-861e-923960390951 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:55.148637 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-315541a6-a283-41aa-861e-923960390951 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:55.157424 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-315541a6-a283-41aa-861e-923960390951 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.312484 Aug 01 14:20:55.159887 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 21/51] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:54 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:55.287085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-9dee7b0c-8075-4a4f-8984-68a2775c5913 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:55.288624 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-9dee7b0c-8075-4a4f-8984-68a2775c5913 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:55.295664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9dee7b0c-8075-4a4f-8984-68a2775c5913 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:55.296326 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9dee7b0c-8075-4a4f-8984-68a2775c5913 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:55.297141 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9dee7b0c-8075-4a4f-8984-68a2775c5913 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:55.297970 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9dee7b0c-8075-4a4f-8984-68a2775c5913 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:55.354147 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c34bcfc9-9710-45d8-9be7-c83c5fc68a42 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:55.354779 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c34bcfc9-9710-45d8-9be7-c83c5fc68a42 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:55.367307 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c34bcfc9-9710-45d8-9be7-c83c5fc68a42 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:55.367777 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c34bcfc9-9710-45d8-9be7-c83c5fc68a42 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:55.370802 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c34bcfc9-9710-45d8-9be7-c83c5fc68a42 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:55.371763 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c34bcfc9-9710-45d8-9be7-c83c5fc68a42 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:55.486185 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c34bcfc9-9710-45d8-9be7-c83c5fc68a42 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:55.496022 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c34bcfc9-9710-45d8-9be7-c83c5fc68a42 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1289 microversion: 2.1 time: 0.147324 Aug 01 14:20:55.504346 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 22/52] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:55 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1289 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:55.537247 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-9dee7b0c-8075-4a4f-8984-68a2775c5913 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:55.545554 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-9dee7b0c-8075-4a4f-8984-68a2775c5913 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.262325 Aug 01 14:20:55.546280 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 31/53] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:55 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:55.657414 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c3a1cb2b-f4aa-40d3-ad72-1ff22998274d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:55.658496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c3a1cb2b-f4aa-40d3-ad72-1ff22998274d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:55.671266 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c3a1cb2b-f4aa-40d3-ad72-1ff22998274d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:55.672263 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c3a1cb2b-f4aa-40d3-ad72-1ff22998274d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:55.675190 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c3a1cb2b-f4aa-40d3-ad72-1ff22998274d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:55.675190 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c3a1cb2b-f4aa-40d3-ad72-1ff22998274d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:55.808461 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c3a1cb2b-f4aa-40d3-ad72-1ff22998274d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:55.819383 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c3a1cb2b-f4aa-40d3-ad72-1ff22998274d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:55.821379 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c3a1cb2b-f4aa-40d3-ad72-1ff22998274d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:55.824405 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c3a1cb2b-f4aa-40d3-ad72-1ff22998274d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1340 microversion: 2.20 time: 0.170167 Aug 01 14:20:55.825304 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 23/54] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:55 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1340 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:20:56.187448 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7548faa7-5007-41a4-915c-582e67b1c010 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:56.190107 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7548faa7-5007-41a4-915c-582e67b1c010 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:56.210640 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7548faa7-5007-41a4-915c-582e67b1c010 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.213947 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7548faa7-5007-41a4-915c-582e67b1c010 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.216177 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7548faa7-5007-41a4-915c-582e67b1c010 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.216746 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7548faa7-5007-41a4-915c-582e67b1c010 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.526249 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-270381e4-f074-4a35-a41a-a9eb6398120e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:56.528508 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-270381e4-f074-4a35-a41a-a9eb6398120e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:56.539945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-270381e4-f074-4a35-a41a-a9eb6398120e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.541255 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-270381e4-f074-4a35-a41a-a9eb6398120e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.542399 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-270381e4-f074-4a35-a41a-a9eb6398120e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.543020 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-270381e4-f074-4a35-a41a-a9eb6398120e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.730188 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-270381e4-f074-4a35-a41a-a9eb6398120e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:56.738522 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-270381e4-f074-4a35-a41a-a9eb6398120e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1297 microversion: 2.1 time: 0.219933 Aug 01 14:20:56.739117 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 24/55] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:56 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1297 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:20:56.775868 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7548faa7-5007-41a4-915c-582e67b1c010 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:56.782927 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1edc342d-e85d-4bcf-b30b-dc735882ff8c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:56.783847 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1edc342d-e85d-4bcf-b30b-dc735882ff8c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:56.797872 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7548faa7-5007-41a4-915c-582e67b1c010 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.618550 Aug 01 14:20:56.798820 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 32/56] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:56 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:56.825602 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1edc342d-e85d-4bcf-b30b-dc735882ff8c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.826094 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1edc342d-e85d-4bcf-b30b-dc735882ff8c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.829978 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1edc342d-e85d-4bcf-b30b-dc735882ff8c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.833268 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1edc342d-e85d-4bcf-b30b-dc735882ff8c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.847621 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3e17e9c4-e0f4-446f-9af5-dbad7c886ddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:56.848252 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3e17e9c4-e0f4-446f-9af5-dbad7c886ddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:56.864646 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3e17e9c4-e0f4-446f-9af5-dbad7c886ddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.865113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3e17e9c4-e0f4-446f-9af5-dbad7c886ddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.866604 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3e17e9c4-e0f4-446f-9af5-dbad7c886ddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.867074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3e17e9c4-e0f4-446f-9af5-dbad7c886ddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.056627 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3e17e9c4-e0f4-446f-9af5-dbad7c886ddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:57.069463 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3e17e9c4-e0f4-446f-9af5-dbad7c886ddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:57.075782 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3e17e9c4-e0f4-446f-9af5-dbad7c886ddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:57.081582 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3e17e9c4-e0f4-446f-9af5-dbad7c886ddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1340 microversion: 2.20 time: 0.237837 Aug 01 14:20:57.112434 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 33/57] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:56 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1340 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:20:57.305175 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1edc342d-e85d-4bcf-b30b-dc735882ff8c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:57.314145 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1edc342d-e85d-4bcf-b30b-dc735882ff8c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.555610 Aug 01 14:20:57.314731 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 25/58] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:56 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:57.766692 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4cff1089-21f9-4957-a20b-ad9fe776dbce tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:57.768456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4cff1089-21f9-4957-a20b-ad9fe776dbce tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:57.777622 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4cff1089-21f9-4957-a20b-ad9fe776dbce tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.779840 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4cff1089-21f9-4957-a20b-ad9fe776dbce tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.781037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4cff1089-21f9-4957-a20b-ad9fe776dbce tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.781835 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4cff1089-21f9-4957-a20b-ad9fe776dbce tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.832566 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-addf3533-d684-4f3e-bfeb-5b202c94282f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:57.836699 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-addf3533-d684-4f3e-bfeb-5b202c94282f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:57.850831 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-addf3533-d684-4f3e-bfeb-5b202c94282f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.850831 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-addf3533-d684-4f3e-bfeb-5b202c94282f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.851369 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-addf3533-d684-4f3e-bfeb-5b202c94282f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.852163 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-addf3533-d684-4f3e-bfeb-5b202c94282f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:58.119155 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4cff1089-21f9-4957-a20b-ad9fe776dbce tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:58.142276 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4cff1089-21f9-4957-a20b-ad9fe776dbce tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1295 microversion: 2.1 time: 0.378415 Aug 01 14:20:58.142276 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 34/59] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:57 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1295 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:58.146279 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f91713e8-c09d-4ff6-bf74-387510a98f29 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:58.147549 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f91713e8-c09d-4ff6-bf74-387510a98f29 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:58.186901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f91713e8-c09d-4ff6-bf74-387510a98f29 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:58.187369 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f91713e8-c09d-4ff6-bf74-387510a98f29 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:58.188254 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f91713e8-c09d-4ff6-bf74-387510a98f29 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:58.188691 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f91713e8-c09d-4ff6-bf74-387510a98f29 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:58.337889 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-addf3533-d684-4f3e-bfeb-5b202c94282f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:58.351405 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-addf3533-d684-4f3e-bfeb-5b202c94282f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.528955 Aug 01 14:20:58.352234 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 26/60] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:57 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:58.369264 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-015684a6-d9fa-4804-9307-411ccc8189db tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:58.370541 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-015684a6-d9fa-4804-9307-411ccc8189db tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:58.377302 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:58.385679 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-015684a6-d9fa-4804-9307-411ccc8189db tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:58.390474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-015684a6-d9fa-4804-9307-411ccc8189db tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:58.390474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-015684a6-d9fa-4804-9307-411ccc8189db tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:58.390474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-015684a6-d9fa-4804-9307-411ccc8189db tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:58.895847 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f91713e8-c09d-4ff6-bf74-387510a98f29 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:58.905080 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f91713e8-c09d-4ff6-bf74-387510a98f29 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:58.906628 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f91713e8-c09d-4ff6-bf74-387510a98f29 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:58.907771 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f91713e8-c09d-4ff6-bf74-387510a98f29 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.768331 Aug 01 14:20:58.908339 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 35/61] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:58 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:59.136733 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-b7478f27-09fc-4533-9141-ef4b1cc4a941 req-321d5186-9735-427d-99ca-ef9ac1b4ca14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3824777-d8b1-4993-a19d-921e3054fde8", "tag": "fb15ef4e-abff-40a5-9a03-acfeb6c36754"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:59.165688 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:59.169540 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-b7478f27-09fc-4533-9141-ef4b1cc4a941 req-321d5186-9735-427d-99ca-ef9ac1b4ca14 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:59.170988 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-b7478f27-09fc-4533-9141-ef4b1cc4a941 req-321d5186-9735-427d-99ca-ef9ac1b4ca14 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:59.234842 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-b7478f27-09fc-4533-9141-ef4b1cc4a941 req-321d5186-9735-427d-99ca-ef9ac1b4ca14 service nova] Creating event network-changed:fb15ef4e-abff-40a5-9a03-acfeb6c36754 for instance c3824777-d8b1-4993-a19d-921e3054fde8 on hv-cinder-78729 Aug 01 14:20:59.236290 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-b7478f27-09fc-4533-9141-ef4b1cc4a941 req-321d5186-9735-427d-99ca-ef9ac1b4ca14 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118246) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 14:20:59.237651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0346f1bf-5ffb-4864-b5ee-c553f93f4fd9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:59.240818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0346f1bf-5ffb-4864-b5ee-c553f93f4fd9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:59.245004 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0346f1bf-5ffb-4864-b5ee-c553f93f4fd9 None None] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:59.245553 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0346f1bf-5ffb-4864-b5ee-c553f93f4fd9 None None] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:59.295282 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.compute.rpcapi [None req-0346f1bf-5ffb-4864-b5ee-c553f93f4fd9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 14:20:59.297269 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0346f1bf-5ffb-4864-b5ee-c553f93f4fd9 None None] Releasing lock "compute-rpcapi-router" {{(pid=118246) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 14:20:59.374934 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0346f1bf-5ffb-4864-b5ee-c553f93f4fd9 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.365427 Aug 01 14:20:59.378875 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 36/62] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:59.401492 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c8228b98-dcfd-4435-8287-914436491ec2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:59.404396 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c8228b98-dcfd-4435-8287-914436491ec2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:59.433194 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c8228b98-dcfd-4435-8287-914436491ec2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:59.434992 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c8228b98-dcfd-4435-8287-914436491ec2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:59.439092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c8228b98-dcfd-4435-8287-914436491ec2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:59.446733 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c8228b98-dcfd-4435-8287-914436491ec2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:59.783509 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c8228b98-dcfd-4435-8287-914436491ec2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:59.800480 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c8228b98-dcfd-4435-8287-914436491ec2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1295 microversion: 2.1 time: 0.415549 Aug 01 14:20:59.801155 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 37/63] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:59 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1295 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:59.806890 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3c241484-4357-4b7c-8fe1-f49af17d5568 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:59.811832 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3c241484-4357-4b7c-8fe1-f49af17d5568 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:59.833705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3c241484-4357-4b7c-8fe1-f49af17d5568 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:59.834245 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3c241484-4357-4b7c-8fe1-f49af17d5568 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:59.837537 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3c241484-4357-4b7c-8fe1-f49af17d5568 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:59.837537 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3c241484-4357-4b7c-8fe1-f49af17d5568 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:59.912484 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-015684a6-d9fa-4804-9307-411ccc8189db tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:59.951416 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-015684a6-d9fa-4804-9307-411ccc8189db tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 1.597942 Aug 01 14:20:59.961624 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 27/64] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:58 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:59.971822 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a09de8b6-906b-4cac-aca6-999eba0d4060 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:59.974563 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a09de8b6-906b-4cac-aca6-999eba0d4060 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:59.994321 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a09de8b6-906b-4cac-aca6-999eba0d4060 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:59.995324 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a09de8b6-906b-4cac-aca6-999eba0d4060 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:59.996289 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a09de8b6-906b-4cac-aca6-999eba0d4060 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:59.996865 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a09de8b6-906b-4cac-aca6-999eba0d4060 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.342165 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3c241484-4357-4b7c-8fe1-f49af17d5568 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:00.358264 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3c241484-4357-4b7c-8fe1-f49af17d5568 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.555843 Aug 01 14:21:00.358858 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 38/65] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:59 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:00.602246 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a09de8b6-906b-4cac-aca6-999eba0d4060 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:00.614634 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a09de8b6-906b-4cac-aca6-999eba0d4060 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:00.627035 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a09de8b6-906b-4cac-aca6-999eba0d4060 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:00.632470 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a09de8b6-906b-4cac-aca6-999eba0d4060 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.669230 Aug 01 14:21:00.634357 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 28/66] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:59 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:00.821666 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=30 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:00.826391 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-bfc114e3-c7db-4dff-bb35-1bee42f9efcf tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:00.827710 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-bfc114e3-c7db-4dff-bb35-1bee42f9efcf tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:00.844503 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bfc114e3-c7db-4dff-bb35-1bee42f9efcf tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:00.844963 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bfc114e3-c7db-4dff-bb35-1bee42f9efcf tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.846871 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bfc114e3-c7db-4dff-bb35-1bee42f9efcf tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:00.847325 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bfc114e3-c7db-4dff-bb35-1bee42f9efcf tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.995940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-74778acb-944a-4b4c-8d31-6de2ddd79904 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:00.996567 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-74778acb-944a-4b4c-8d31-6de2ddd79904 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:01.011508 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-74778acb-944a-4b4c-8d31-6de2ddd79904 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.013490 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-74778acb-944a-4b4c-8d31-6de2ddd79904 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.013490 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-74778acb-944a-4b4c-8d31-6de2ddd79904 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.017423 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-74778acb-944a-4b4c-8d31-6de2ddd79904 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.256203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-bfc114e3-c7db-4dff-bb35-1bee42f9efcf tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:01.273239 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-bfc114e3-c7db-4dff-bb35-1bee42f9efcf tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.445362 Aug 01 14:21:01.273239 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 39/67] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:00 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:01.376112 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-74778acb-944a-4b4c-8d31-6de2ddd79904 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:01.384437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ff9337e4-e1e0-4a04-a94f-b15fc2a9462b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:01.385054 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ff9337e4-e1e0-4a04-a94f-b15fc2a9462b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:01.398949 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-74778acb-944a-4b4c-8d31-6de2ddd79904 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.401519 Aug 01 14:21:01.399488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 29/68] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:00 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:01.400079 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ff9337e4-e1e0-4a04-a94f-b15fc2a9462b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.400703 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ff9337e4-e1e0-4a04-a94f-b15fc2a9462b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.401644 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ff9337e4-e1e0-4a04-a94f-b15fc2a9462b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.402259 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ff9337e4-e1e0-4a04-a94f-b15fc2a9462b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.419057 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-4f076411-d810-4dc5-a108-b255975878dd req-f37a9623-206c-42b4-a781-3911a200203d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e", "tag": "38972512-acb0-4637-b22c-a3933134341b"}, {"name": "network-changed", "server_uuid": "b4eb6448-faf6-4409-bc4d-591b29ab2e52", "tag": "08093b92-1518-49dd-ab00-5865b4e9fb4f"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:01.429978 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=8 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:01.440593 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=100 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:01.441813 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-4f076411-d810-4dc5-a108-b255975878dd req-f37a9623-206c-42b4-a781-3911a200203d service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.442425 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-4f076411-d810-4dc5-a108-b255975878dd req-f37a9623-206c-42b4-a781-3911a200203d service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.474439 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=100 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:01.479145 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-4f076411-d810-4dc5-a108-b255975878dd req-f37a9623-206c-42b4-a781-3911a200203d service nova] Creating event network-changed:38972512-acb0-4637-b22c-a3933134341b for instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e on hv-cinder-78729 Aug 01 14:21:01.480169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-4f076411-d810-4dc5-a108-b255975878dd req-f37a9623-206c-42b4-a781-3911a200203d service nova] Creating event network-changed:08093b92-1518-49dd-ab00-5865b4e9fb4f for instance b4eb6448-faf6-4409-bc4d-591b29ab2e52 on hv-cinder-78729 Aug 01 14:21:01.480932 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-4f076411-d810-4dc5-a108-b255975878dd req-f37a9623-206c-42b4-a781-3911a200203d service nova] Acquired lock "compute-rpcapi-router" {{(pid=118247) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 14:21:01.482284 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9452ec11-3861-4da4-9479-a196afde0c5f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.482936 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9452ec11-3861-4da4-9479-a196afde0c5f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.483888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9452ec11-3861-4da4-9479-a196afde0c5f None None] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.484501 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9452ec11-3861-4da4-9479-a196afde0c5f None None] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.496262 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.compute.rpcapi [None req-9452ec11-3861-4da4-9479-a196afde0c5f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 14:21:01.497939 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9452ec11-3861-4da4-9479-a196afde0c5f None None] Releasing lock "compute-rpcapi-router" {{(pid=118247) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 14:21:01.551884 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-9452ec11-3861-4da4-9479-a196afde0c5f None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.136802 Aug 01 14:21:01.552646 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 30/69] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:01.608211 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ff9337e4-e1e0-4a04-a94f-b15fc2a9462b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:01.617213 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ff9337e4-e1e0-4a04-a94f-b15fc2a9462b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.238456 Aug 01 14:21:01.618147 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 40/70] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:01 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:01.659727 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-454e77c7-e1eb-4cc8-b202-543721c92a2a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:01.660640 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-454e77c7-e1eb-4cc8-b202-543721c92a2a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:01.667383 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-454e77c7-e1eb-4cc8-b202-543721c92a2a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.667926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-454e77c7-e1eb-4cc8-b202-543721c92a2a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.668800 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-454e77c7-e1eb-4cc8-b202-543721c92a2a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.669245 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-454e77c7-e1eb-4cc8-b202-543721c92a2a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.830072 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-454e77c7-e1eb-4cc8-b202-543721c92a2a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:01.837499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-454e77c7-e1eb-4cc8-b202-543721c92a2a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:01.840860 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-454e77c7-e1eb-4cc8-b202-543721c92a2a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:01.855961 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-454e77c7-e1eb-4cc8-b202-543721c92a2a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.187758 Aug 01 14:21:01.862500 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 31/71] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:01 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:02.292070 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-806e22d9-b4bf-4105-88a5-90b320f33e45 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:02.292718 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-806e22d9-b4bf-4105-88a5-90b320f33e45 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:02.305115 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-806e22d9-b4bf-4105-88a5-90b320f33e45 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.306213 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-806e22d9-b4bf-4105-88a5-90b320f33e45 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.307189 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-806e22d9-b4bf-4105-88a5-90b320f33e45 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.307637 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-806e22d9-b4bf-4105-88a5-90b320f33e45 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.421917 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e49a51b3-8df3-44d4-8027-2c1d01b6cb1a tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:02.422580 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e49a51b3-8df3-44d4-8027-2c1d01b6cb1a tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:02.430215 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e49a51b3-8df3-44d4-8027-2c1d01b6cb1a tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.430722 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e49a51b3-8df3-44d4-8027-2c1d01b6cb1a tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.431586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e49a51b3-8df3-44d4-8027-2c1d01b6cb1a tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.432552 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e49a51b3-8df3-44d4-8027-2c1d01b6cb1a tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.480222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-806e22d9-b4bf-4105-88a5-90b320f33e45 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:02.497815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-806e22d9-b4bf-4105-88a5-90b320f33e45 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.200967 Aug 01 14:21:02.497815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 41/72] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:02 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:02.637994 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-251c19a7-f2f0-4a5f-863b-7e40d909a4b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:02.638973 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-251c19a7-f2f0-4a5f-863b-7e40d909a4b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:02.645899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-251c19a7-f2f0-4a5f-863b-7e40d909a4b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.646351 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-251c19a7-f2f0-4a5f-863b-7e40d909a4b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.647796 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-251c19a7-f2f0-4a5f-863b-7e40d909a4b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.648241 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-251c19a7-f2f0-4a5f-863b-7e40d909a4b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.727953 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e49a51b3-8df3-44d4-8027-2c1d01b6cb1a tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:02.737340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e49a51b3-8df3-44d4-8027-2c1d01b6cb1a tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.320977 Aug 01 14:21:02.738053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 32/73] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:02 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:02.830065 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-251c19a7-f2f0-4a5f-863b-7e40d909a4b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:02.838122 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-251c19a7-f2f0-4a5f-863b-7e40d909a4b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.203871 Aug 01 14:21:02.838748 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 42/74] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:02 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:02.879324 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-652b64bf-fa20-449d-953d-14b54e85e46a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:02.880168 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-652b64bf-fa20-449d-953d-14b54e85e46a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:02.887731 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-652b64bf-fa20-449d-953d-14b54e85e46a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.888451 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-652b64bf-fa20-449d-953d-14b54e85e46a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.889241 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-652b64bf-fa20-449d-953d-14b54e85e46a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.889682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-652b64bf-fa20-449d-953d-14b54e85e46a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:03.032698 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-652b64bf-fa20-449d-953d-14b54e85e46a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:03.041624 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-652b64bf-fa20-449d-953d-14b54e85e46a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:03.043173 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-652b64bf-fa20-449d-953d-14b54e85e46a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:03.044283 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-652b64bf-fa20-449d-953d-14b54e85e46a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.168816 Aug 01 14:21:03.044849 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 33/75] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:02 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:03.521300 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0d9cc07f-54b4-47a2-84e9-2fdc5c2e5ad2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:03.523334 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0d9cc07f-54b4-47a2-84e9-2fdc5c2e5ad2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:03.531586 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0d9cc07f-54b4-47a2-84e9-2fdc5c2e5ad2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:03.532218 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0d9cc07f-54b4-47a2-84e9-2fdc5c2e5ad2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:03.533373 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0d9cc07f-54b4-47a2-84e9-2fdc5c2e5ad2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:03.534500 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0d9cc07f-54b4-47a2-84e9-2fdc5c2e5ad2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:03.573499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-04c94e6e-b3bf-4213-8017-676f9ba4d9fa req-ab6aabbc-230f-43ba-8f03-f68846e458a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c41c564-40f2-47cf-820b-915c3d43ccb3", "tag": "bc816aff-9768-4c40-a6d1-adb40e9ce6a1"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:03.596005 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=28 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:03.599210 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-04c94e6e-b3bf-4213-8017-676f9ba4d9fa req-ab6aabbc-230f-43ba-8f03-f68846e458a7 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:03.600498 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-04c94e6e-b3bf-4213-8017-676f9ba4d9fa req-ab6aabbc-230f-43ba-8f03-f68846e458a7 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:03.633593 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-04c94e6e-b3bf-4213-8017-676f9ba4d9fa req-ab6aabbc-230f-43ba-8f03-f68846e458a7 service nova] Creating event network-changed:bc816aff-9768-4c40-a6d1-adb40e9ce6a1 for instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 on hv-cinder-78729 Aug 01 14:21:03.639496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-04c94e6e-b3bf-4213-8017-676f9ba4d9fa req-ab6aabbc-230f-43ba-8f03-f68846e458a7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070692 Aug 01 14:21:03.641342 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 34/76] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:21:03.763324 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e905c880-c60b-4ab0-96b6-5f47f8c6fed6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:03.768224 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e905c880-c60b-4ab0-96b6-5f47f8c6fed6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:03.781821 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e905c880-c60b-4ab0-96b6-5f47f8c6fed6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:03.782022 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-0d9cc07f-54b4-47a2-84e9-2fdc5c2e5ad2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:03.794202 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0d9cc07f-54b4-47a2-84e9-2fdc5c2e5ad2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.277335 Aug 01 14:21:03.795003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e905c880-c60b-4ab0-96b6-5f47f8c6fed6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:03.796397 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e905c880-c60b-4ab0-96b6-5f47f8c6fed6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:03.796857 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e905c880-c60b-4ab0-96b6-5f47f8c6fed6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:03.808019 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 43/77] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:03 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:03.860124 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c0c998d0-387a-49da-a232-c109dcb124a9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:03.861166 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c0c998d0-387a-49da-a232-c109dcb124a9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:03.869415 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c0c998d0-387a-49da-a232-c109dcb124a9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:03.870522 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c0c998d0-387a-49da-a232-c109dcb124a9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:03.871495 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c0c998d0-387a-49da-a232-c109dcb124a9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:03.872527 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c0c998d0-387a-49da-a232-c109dcb124a9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:04.104019 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c0c998d0-387a-49da-a232-c109dcb124a9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:04.120709 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c0c998d0-387a-49da-a232-c109dcb124a9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.264257 Aug 01 14:21:04.121558 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 44/78] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:03 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:04.131428 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e905c880-c60b-4ab0-96b6-5f47f8c6fed6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:04.147493 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e905c880-c60b-4ab0-96b6-5f47f8c6fed6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.388517 Aug 01 14:21:04.149946 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-2efa177c-990c-40ac-a4bd-2695a195d205 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:04.152402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-2efa177c-990c-40ac-a4bd-2695a195d205 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:04.159424 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2efa177c-990c-40ac-a4bd-2695a195d205 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:04.160108 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2efa177c-990c-40ac-a4bd-2695a195d205 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:04.161025 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2efa177c-990c-40ac-a4bd-2695a195d205 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:04.161851 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2efa177c-990c-40ac-a4bd-2695a195d205 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:04.166361 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 35/79] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:03 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:04.458487 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2efa177c-990c-40ac-a4bd-2695a195d205 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:04.467595 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2efa177c-990c-40ac-a4bd-2695a195d205 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:04.469125 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2efa177c-990c-40ac-a4bd-2695a195d205 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:04.470309 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-2efa177c-990c-40ac-a4bd-2695a195d205 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.343419 Aug 01 14:21:04.486060 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 45/80] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:04 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:04.818252 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-560d0848-b510-4f8d-b099-1bc09d58a0c6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:04.819622 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-560d0848-b510-4f8d-b099-1bc09d58a0c6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:04.827026 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-560d0848-b510-4f8d-b099-1bc09d58a0c6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:04.827801 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-560d0848-b510-4f8d-b099-1bc09d58a0c6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:04.828729 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-560d0848-b510-4f8d-b099-1bc09d58a0c6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:04.829450 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-560d0848-b510-4f8d-b099-1bc09d58a0c6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:05.001539 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-560d0848-b510-4f8d-b099-1bc09d58a0c6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:05.011416 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-560d0848-b510-4f8d-b099-1bc09d58a0c6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.197622 Aug 01 14:21:05.012443 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 36/81] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:04 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:05.142782 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-35a4a5dc-33b0-4a19-9417-c2004128dc10 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:05.144336 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-35a4a5dc-33b0-4a19-9417-c2004128dc10 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:05.151413 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-35a4a5dc-33b0-4a19-9417-c2004128dc10 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:05.152376 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-35a4a5dc-33b0-4a19-9417-c2004128dc10 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:05.153393 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-35a4a5dc-33b0-4a19-9417-c2004128dc10 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:05.153873 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-35a4a5dc-33b0-4a19-9417-c2004128dc10 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:05.175405 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c2796fc3-010b-4f6c-9d81-d7c8fd59f10e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:05.176142 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c2796fc3-010b-4f6c-9d81-d7c8fd59f10e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:05.184797 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c2796fc3-010b-4f6c-9d81-d7c8fd59f10e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:05.185725 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c2796fc3-010b-4f6c-9d81-d7c8fd59f10e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:05.186610 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c2796fc3-010b-4f6c-9d81-d7c8fd59f10e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:05.187109 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c2796fc3-010b-4f6c-9d81-d7c8fd59f10e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:05.391298 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-35a4a5dc-33b0-4a19-9417-c2004128dc10 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:05.408773 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-35a4a5dc-33b0-4a19-9417-c2004128dc10 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.261963 Aug 01 14:21:05.408773 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 46/82] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:05 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:05.464424 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c2796fc3-010b-4f6c-9d81-d7c8fd59f10e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:05.472148 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c2796fc3-010b-4f6c-9d81-d7c8fd59f10e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.301417 Aug 01 14:21:05.472713 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 37/83] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:05 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:05.494107 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c1469d24-3362-41bd-a67d-6b6dbc979de1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:05.495264 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c1469d24-3362-41bd-a67d-6b6dbc979de1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:05.502674 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c1469d24-3362-41bd-a67d-6b6dbc979de1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:05.503415 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c1469d24-3362-41bd-a67d-6b6dbc979de1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:05.504153 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c1469d24-3362-41bd-a67d-6b6dbc979de1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:05.504621 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c1469d24-3362-41bd-a67d-6b6dbc979de1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:05.728377 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c1469d24-3362-41bd-a67d-6b6dbc979de1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:05.737004 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c1469d24-3362-41bd-a67d-6b6dbc979de1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:05.738685 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c1469d24-3362-41bd-a67d-6b6dbc979de1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:05.739819 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c1469d24-3362-41bd-a67d-6b6dbc979de1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.251188 Aug 01 14:21:05.740969 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 47/84] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:05 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:06.036888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3f724088-2584-4170-9d75-b5d59fac6d5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:06.042206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3f724088-2584-4170-9d75-b5d59fac6d5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:06.056456 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3f724088-2584-4170-9d75-b5d59fac6d5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.057185 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3f724088-2584-4170-9d75-b5d59fac6d5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.058415 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3f724088-2584-4170-9d75-b5d59fac6d5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.058943 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3f724088-2584-4170-9d75-b5d59fac6d5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.209645 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3f724088-2584-4170-9d75-b5d59fac6d5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:06.217260 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3f724088-2584-4170-9d75-b5d59fac6d5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.187615 Aug 01 14:21:06.217853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 38/85] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:06 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:06.427207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-357d76a5-c767-4a0c-bd33-e37c2a740894 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:06.428474 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-357d76a5-c767-4a0c-bd33-e37c2a740894 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:06.435658 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-357d76a5-c767-4a0c-bd33-e37c2a740894 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.436116 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-357d76a5-c767-4a0c-bd33-e37c2a740894 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.436895 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-357d76a5-c767-4a0c-bd33-e37c2a740894 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.437821 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-357d76a5-c767-4a0c-bd33-e37c2a740894 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.498367 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-88013be2-2a2a-4a2f-9d67-c48ebfa68ef6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:06.499125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-88013be2-2a2a-4a2f-9d67-c48ebfa68ef6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:06.505951 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-88013be2-2a2a-4a2f-9d67-c48ebfa68ef6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.506590 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-88013be2-2a2a-4a2f-9d67-c48ebfa68ef6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.508164 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-88013be2-2a2a-4a2f-9d67-c48ebfa68ef6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.508664 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-88013be2-2a2a-4a2f-9d67-c48ebfa68ef6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.685055 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-357d76a5-c767-4a0c-bd33-e37c2a740894 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:06.693530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-357d76a5-c767-4a0c-bd33-e37c2a740894 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.271056 Aug 01 14:21:06.695149 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 48/86] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:06 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:06.714663 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-88013be2-2a2a-4a2f-9d67-c48ebfa68ef6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:06.722082 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-88013be2-2a2a-4a2f-9d67-c48ebfa68ef6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.229038 Aug 01 14:21:06.722652 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 39/87] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:06 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:06.763331 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-64e0f8ee-cc4a-4b8b-94ea-7b78a7b5aa82 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:06.763944 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-64e0f8ee-cc4a-4b8b-94ea-7b78a7b5aa82 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:06.772445 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-64e0f8ee-cc4a-4b8b-94ea-7b78a7b5aa82 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.772445 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-64e0f8ee-cc4a-4b8b-94ea-7b78a7b5aa82 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.772445 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-64e0f8ee-cc4a-4b8b-94ea-7b78a7b5aa82 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.772445 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-64e0f8ee-cc4a-4b8b-94ea-7b78a7b5aa82 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.929482 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-64e0f8ee-cc4a-4b8b-94ea-7b78a7b5aa82 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:06.937675 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-64e0f8ee-cc4a-4b8b-94ea-7b78a7b5aa82 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:06.939347 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-64e0f8ee-cc4a-4b8b-94ea-7b78a7b5aa82 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:06.940462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-64e0f8ee-cc4a-4b8b-94ea-7b78a7b5aa82 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.181112 Aug 01 14:21:06.941032 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 49/88] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:06 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:07.238016 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-5938a129-3106-445d-94df-897799dd2320 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:07.238651 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-5938a129-3106-445d-94df-897799dd2320 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:07.245332 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5938a129-3106-445d-94df-897799dd2320 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.245811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5938a129-3106-445d-94df-897799dd2320 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.246594 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5938a129-3106-445d-94df-897799dd2320 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.247062 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5938a129-3106-445d-94df-897799dd2320 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.406183 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-5938a129-3106-445d-94df-897799dd2320 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:07.414995 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-5938a129-3106-445d-94df-897799dd2320 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.180412 Aug 01 14:21:07.415579 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 40/89] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:07 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:07.715366 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-438326b2-1502-4f8f-893e-bdea3e90cf15 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:07.716798 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-438326b2-1502-4f8f-893e-bdea3e90cf15 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:07.723513 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-438326b2-1502-4f8f-893e-bdea3e90cf15 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.724379 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-438326b2-1502-4f8f-893e-bdea3e90cf15 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.725704 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-438326b2-1502-4f8f-893e-bdea3e90cf15 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.726451 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-438326b2-1502-4f8f-893e-bdea3e90cf15 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.743739 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-406f0abf-80ed-4af9-90c7-0e92ba6169f0 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:07.745275 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-406f0abf-80ed-4af9-90c7-0e92ba6169f0 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:07.765716 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-406f0abf-80ed-4af9-90c7-0e92ba6169f0 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.767344 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-406f0abf-80ed-4af9-90c7-0e92ba6169f0 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.768387 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-406f0abf-80ed-4af9-90c7-0e92ba6169f0 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.769048 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-406f0abf-80ed-4af9-90c7-0e92ba6169f0 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.248485 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-438326b2-1502-4f8f-893e-bdea3e90cf15 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:08.254903 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-406f0abf-80ed-4af9-90c7-0e92ba6169f0 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:08.260215 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-438326b2-1502-4f8f-893e-bdea3e90cf15 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.548627 Aug 01 14:21:08.261132 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 50/90] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:07 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:08.270306 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-2197ecae-d659-482f-a345-9637526a3792 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:08.270883 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-2197ecae-d659-482f-a345-9637526a3792 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:08.280386 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-406f0abf-80ed-4af9-90c7-0e92ba6169f0 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.541773 Aug 01 14:21:08.280739 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2197ecae-d659-482f-a345-9637526a3792 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:08.281350 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2197ecae-d659-482f-a345-9637526a3792 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.286101 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2197ecae-d659-482f-a345-9637526a3792 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:08.286101 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2197ecae-d659-482f-a345-9637526a3792 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.289258 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 41/91] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:07 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:08.451806 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0a24a151-3ed5-47ae-9289-f3c66acdc274 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:08.452558 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0a24a151-3ed5-47ae-9289-f3c66acdc274 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:08.461256 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0a24a151-3ed5-47ae-9289-f3c66acdc274 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:08.462112 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0a24a151-3ed5-47ae-9289-f3c66acdc274 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.463408 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0a24a151-3ed5-47ae-9289-f3c66acdc274 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:08.464159 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0a24a151-3ed5-47ae-9289-f3c66acdc274 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.539691 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2197ecae-d659-482f-a345-9637526a3792 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:08.553424 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2197ecae-d659-482f-a345-9637526a3792 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:08.555026 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2197ecae-d659-482f-a345-9637526a3792 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:08.556171 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-2197ecae-d659-482f-a345-9637526a3792 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.294008 Aug 01 14:21:08.560766 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 51/92] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:08 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:08.774183 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0a24a151-3ed5-47ae-9289-f3c66acdc274 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:08.785075 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0a24a151-3ed5-47ae-9289-f3c66acdc274 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.338839 Aug 01 14:21:08.793970 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 42/93] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:08 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:09.233185 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-4ea5db6f-9bd2-49d6-843e-cb80563cf085 req-1ec9bcf8-44c8-4146-ae0d-a4e678e85069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb5f425-d747-41d4-bed5-211a5d80e32b", "tag": "5314437c-b6c2-401f-b4c2-178a92e38017"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:09.245541 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-4ea5db6f-9bd2-49d6-843e-cb80563cf085 req-1ec9bcf8-44c8-4146-ae0d-a4e678e85069 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.256443 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-4ea5db6f-9bd2-49d6-843e-cb80563cf085 req-1ec9bcf8-44c8-4146-ae0d-a4e678e85069 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.258440 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-4ea5db6f-9bd2-49d6-843e-cb80563cf085 req-1ec9bcf8-44c8-4146-ae0d-a4e678e85069 service nova] Creating event network-changed:5314437c-b6c2-401f-b4c2-178a92e38017 for instance 2eb5f425-d747-41d4-bed5-211a5d80e32b on hv-cinder-78729 Aug 01 14:21:09.263267 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-4ea5db6f-9bd2-49d6-843e-cb80563cf085 req-1ec9bcf8-44c8-4146-ae0d-a4e678e85069 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093202 Aug 01 14:21:09.264019 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 52/94] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:21:09.282057 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c9cfb79d-a815-40b8-94e9-edef467fec6c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:09.282675 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c9cfb79d-a815-40b8-94e9-edef467fec6c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:09.289186 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c9cfb79d-a815-40b8-94e9-edef467fec6c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.298294 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c9cfb79d-a815-40b8-94e9-edef467fec6c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.298294 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c9cfb79d-a815-40b8-94e9-edef467fec6c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.298294 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c9cfb79d-a815-40b8-94e9-edef467fec6c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.299672 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=4 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:09.304491 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d6ef5880-d940-4416-98b3-d0830611415b tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:09.305195 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d6ef5880-d940-4416-98b3-d0830611415b tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:09.311749 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d6ef5880-d940-4416-98b3-d0830611415b tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.312225 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d6ef5880-d940-4416-98b3-d0830611415b tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.312969 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d6ef5880-d940-4416-98b3-d0830611415b tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.313408 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d6ef5880-d940-4416-98b3-d0830611415b tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.491405 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c9cfb79d-a815-40b8-94e9-edef467fec6c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:09.500747 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c9cfb79d-a815-40b8-94e9-edef467fec6c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.222653 Aug 01 14:21:09.501346 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 43/95] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:09 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:09.555655 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d6ef5880-d940-4416-98b3-d0830611415b tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:09.563501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d6ef5880-d940-4416-98b3-d0830611415b tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.264675 Aug 01 14:21:09.564078 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 53/96] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:09 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:09.588579 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-046bda4b-6a6a-474a-beb6-ca6df91721d7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:09.589020 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-046bda4b-6a6a-474a-beb6-ca6df91721d7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:09.595197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-046bda4b-6a6a-474a-beb6-ca6df91721d7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.595879 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-046bda4b-6a6a-474a-beb6-ca6df91721d7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.596834 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-046bda4b-6a6a-474a-beb6-ca6df91721d7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.597461 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-046bda4b-6a6a-474a-beb6-ca6df91721d7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.735849 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-046bda4b-6a6a-474a-beb6-ca6df91721d7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:09.744402 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-046bda4b-6a6a-474a-beb6-ca6df91721d7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:09.746240 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-046bda4b-6a6a-474a-beb6-ca6df91721d7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:09.747358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-046bda4b-6a6a-474a-beb6-ca6df91721d7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.164116 Aug 01 14:21:09.747931 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 44/97] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:09 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:09.808346 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-086dd877-3794-4232-b8c1-da7195c404b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:09.808872 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-086dd877-3794-4232-b8c1-da7195c404b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:09.815366 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-086dd877-3794-4232-b8c1-da7195c404b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.819119 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-086dd877-3794-4232-b8c1-da7195c404b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.819119 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-086dd877-3794-4232-b8c1-da7195c404b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:09.819119 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-086dd877-3794-4232-b8c1-da7195c404b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:09.951757 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-086dd877-3794-4232-b8c1-da7195c404b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:09.963457 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-086dd877-3794-4232-b8c1-da7195c404b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.159028 Aug 01 14:21:09.964047 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 54/98] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:09 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:10.525424 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-29b11d81-df70-43de-884f-c1c53758eab7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:10.526091 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-29b11d81-df70-43de-884f-c1c53758eab7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:10.539363 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-29b11d81-df70-43de-884f-c1c53758eab7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:10.539819 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-29b11d81-df70-43de-884f-c1c53758eab7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:10.546686 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-29b11d81-df70-43de-884f-c1c53758eab7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:10.546686 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-29b11d81-df70-43de-884f-c1c53758eab7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:10.587053 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-15d42760-4595-4c79-8684-d9c5450c07b4 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:10.587669 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-15d42760-4595-4c79-8684-d9c5450c07b4 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:10.610080 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-15d42760-4595-4c79-8684-d9c5450c07b4 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:10.610565 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-15d42760-4595-4c79-8684-d9c5450c07b4 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:10.611353 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-15d42760-4595-4c79-8684-d9c5450c07b4 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:10.611827 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-15d42760-4595-4c79-8684-d9c5450c07b4 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:10.852019 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-29b11d81-df70-43de-884f-c1c53758eab7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:10.859934 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-29b11d81-df70-43de-884f-c1c53758eab7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.341105 Aug 01 14:21:10.868153 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 45/99] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:10 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:10.873859 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6ff775fa-2304-496c-9392-f7d78c4ad4b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:10.874767 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-6ff775fa-2304-496c-9392-f7d78c4ad4b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:10.876937 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-15d42760-4595-4c79-8684-d9c5450c07b4 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:10.881160 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6ff775fa-2304-496c-9392-f7d78c4ad4b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:10.881655 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6ff775fa-2304-496c-9392-f7d78c4ad4b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:10.882477 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6ff775fa-2304-496c-9392-f7d78c4ad4b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:10.882989 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6ff775fa-2304-496c-9392-f7d78c4ad4b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:10.885204 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-15d42760-4595-4c79-8684-d9c5450c07b4 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.302993 Aug 01 14:21:10.891682 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 55/100] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:10 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:10.991965 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3bb7dd8f-e29b-488f-bbd6-220610e15533 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:10.991965 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3bb7dd8f-e29b-488f-bbd6-220610e15533 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:10.994441 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3bb7dd8f-e29b-488f-bbd6-220610e15533 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:10.995206 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3bb7dd8f-e29b-488f-bbd6-220610e15533 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:10.996230 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3bb7dd8f-e29b-488f-bbd6-220610e15533 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:10.996698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3bb7dd8f-e29b-488f-bbd6-220610e15533 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:11.022925 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6ff775fa-2304-496c-9392-f7d78c4ad4b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:11.031344 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6ff775fa-2304-496c-9392-f7d78c4ad4b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:11.032951 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6ff775fa-2304-496c-9392-f7d78c4ad4b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:11.034370 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-6ff775fa-2304-496c-9392-f7d78c4ad4b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.164959 Aug 01 14:21:11.035007 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 46/101] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:10 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:11.139330 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3bb7dd8f-e29b-488f-bbd6-220610e15533 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:11.166561 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3bb7dd8f-e29b-488f-bbd6-220610e15533 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.184628 Aug 01 14:21:11.174724 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 56/102] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:10 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:11.890212 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-169b407a-8305-45e1-9398-96892869e1d5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:11.890212 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-169b407a-8305-45e1-9398-96892869e1d5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:11.901006 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-169b407a-8305-45e1-9398-96892869e1d5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:11.906920 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7f920534-7ae3-4c36-b0b7-1daaff544424 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:11.907653 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7f920534-7ae3-4c36-b0b7-1daaff544424 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:11.911290 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-169b407a-8305-45e1-9398-96892869e1d5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:11.914337 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-169b407a-8305-45e1-9398-96892869e1d5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:11.916328 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7f920534-7ae3-4c36-b0b7-1daaff544424 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:11.916827 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-169b407a-8305-45e1-9398-96892869e1d5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:11.921833 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7f920534-7ae3-4c36-b0b7-1daaff544424 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:11.923039 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7f920534-7ae3-4c36-b0b7-1daaff544424 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:11.923691 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7f920534-7ae3-4c36-b0b7-1daaff544424 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:12.422168 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-169b407a-8305-45e1-9398-96892869e1d5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:12.426232 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=100 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:12.432605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-169b407a-8305-45e1-9398-96892869e1d5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.553530 Aug 01 14:21:12.446654 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 47/103] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:11 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:12.447110 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7f920534-7ae3-4c36-b0b7-1daaff544424 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:12.447110 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=100 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:12.447259 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6342f83c-54a5-48d3-8586-77120a8ddd12 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:12.447259 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-6342f83c-54a5-48d3-8586-77120a8ddd12 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:12.447404 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7f920534-7ae3-4c36-b0b7-1daaff544424 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.543951 Aug 01 14:21:12.447863 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 57/104] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:11 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:12.462001 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=2 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:12.466378 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6342f83c-54a5-48d3-8586-77120a8ddd12 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:12.466838 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6342f83c-54a5-48d3-8586-77120a8ddd12 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:12.467616 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6342f83c-54a5-48d3-8586-77120a8ddd12 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:12.468058 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6342f83c-54a5-48d3-8586-77120a8ddd12 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:12.471383 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e87d4fe3-6db8-4782-b29b-b171d3211e8c tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:12.472193 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e87d4fe3-6db8-4782-b29b-b171d3211e8c tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:12.483917 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e87d4fe3-6db8-4782-b29b-b171d3211e8c tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:12.487960 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e87d4fe3-6db8-4782-b29b-b171d3211e8c tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:12.487960 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e87d4fe3-6db8-4782-b29b-b171d3211e8c tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:12.487960 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e87d4fe3-6db8-4782-b29b-b171d3211e8c tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:12.685776 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6342f83c-54a5-48d3-8586-77120a8ddd12 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:12.699986 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6342f83c-54a5-48d3-8586-77120a8ddd12 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:12.701789 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6342f83c-54a5-48d3-8586-77120a8ddd12 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:12.703554 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-6342f83c-54a5-48d3-8586-77120a8ddd12 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.269377 Aug 01 14:21:12.704473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 48/105] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:12 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:12.730508 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e87d4fe3-6db8-4782-b29b-b171d3211e8c tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:12.739294 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e87d4fe3-6db8-4782-b29b-b171d3211e8c tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.289995 Aug 01 14:21:12.741466 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 58/106] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:12 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:13.459472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-214ab45c-d41b-4544-8270-582fbf5145a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:13.462633 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-214ab45c-d41b-4544-8270-582fbf5145a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:13.469311 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e193e99b-22d5-4008-a5f9-213866ffc111 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:13.470127 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-214ab45c-d41b-4544-8270-582fbf5145a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.470944 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e193e99b-22d5-4008-a5f9-213866ffc111 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:13.471172 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-214ab45c-d41b-4544-8270-582fbf5145a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:13.472344 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-214ab45c-d41b-4544-8270-582fbf5145a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.472991 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-214ab45c-d41b-4544-8270-582fbf5145a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:13.479564 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e193e99b-22d5-4008-a5f9-213866ffc111 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.480401 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e193e99b-22d5-4008-a5f9-213866ffc111 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:13.481559 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e193e99b-22d5-4008-a5f9-213866ffc111 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.482213 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e193e99b-22d5-4008-a5f9-213866ffc111 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:13.768800 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e193e99b-22d5-4008-a5f9-213866ffc111 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:13.792826 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e193e99b-22d5-4008-a5f9-213866ffc111 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.328136 Aug 01 14:21:13.796228 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 59/107] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:13 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:13.803129 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d3b059c8-3490-43b9-8d85-17989ac78e71 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:13.803812 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-214ab45c-d41b-4544-8270-582fbf5145a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:13.803916 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d3b059c8-3490-43b9-8d85-17989ac78e71 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:13.817369 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d3b059c8-3490-43b9-8d85-17989ac78e71 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.817369 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d3b059c8-3490-43b9-8d85-17989ac78e71 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:13.817369 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d3b059c8-3490-43b9-8d85-17989ac78e71 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.817369 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d3b059c8-3490-43b9-8d85-17989ac78e71 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:13.817700 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-214ab45c-d41b-4544-8270-582fbf5145a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.360277 Aug 01 14:21:13.817700 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 49/108] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:13 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:13.822638 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-70b63391-21a3-4bbe-948b-7e9c005f3619 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:13.824379 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-70b63391-21a3-4bbe-948b-7e9c005f3619 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:13.833319 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-70b63391-21a3-4bbe-948b-7e9c005f3619 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.834691 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-70b63391-21a3-4bbe-948b-7e9c005f3619 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:13.836012 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-70b63391-21a3-4bbe-948b-7e9c005f3619 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:13.836592 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-70b63391-21a3-4bbe-948b-7e9c005f3619 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:14.032764 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d3b059c8-3490-43b9-8d85-17989ac78e71 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:14.041322 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d3b059c8-3490-43b9-8d85-17989ac78e71 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:14.043180 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d3b059c8-3490-43b9-8d85-17989ac78e71 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:14.044370 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d3b059c8-3490-43b9-8d85-17989ac78e71 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.246881 Aug 01 14:21:14.044879 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 60/109] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:13 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:14.048447 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-70b63391-21a3-4bbe-948b-7e9c005f3619 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:14.057651 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-70b63391-21a3-4bbe-948b-7e9c005f3619 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.240566 Aug 01 14:21:14.064329 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 50/110] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:13 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:14.817052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c2d1f889-21fb-475a-86c2-469d0cfcbca6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:14.820306 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c2d1f889-21fb-475a-86c2-469d0cfcbca6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:14.836878 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-fb7d9391-7719-4e4f-8b44-e7561982e2dd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:14.837734 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c2d1f889-21fb-475a-86c2-469d0cfcbca6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:14.838294 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-fb7d9391-7719-4e4f-8b44-e7561982e2dd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:14.838413 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c2d1f889-21fb-475a-86c2-469d0cfcbca6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:14.839143 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c2d1f889-21fb-475a-86c2-469d0cfcbca6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:14.839584 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c2d1f889-21fb-475a-86c2-469d0cfcbca6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:14.848202 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fb7d9391-7719-4e4f-8b44-e7561982e2dd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:14.853968 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fb7d9391-7719-4e4f-8b44-e7561982e2dd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:14.855956 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fb7d9391-7719-4e4f-8b44-e7561982e2dd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:14.859738 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fb7d9391-7719-4e4f-8b44-e7561982e2dd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:15.145566 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c2d1f889-21fb-475a-86c2-469d0cfcbca6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:15.149631 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-fb7d9391-7719-4e4f-8b44-e7561982e2dd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:15.158283 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c2d1f889-21fb-475a-86c2-469d0cfcbca6 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.345403 Aug 01 14:21:15.158628 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-fb7d9391-7719-4e4f-8b44-e7561982e2dd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.325900 Aug 01 14:21:15.159396 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 61/111] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:14 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:15.165724 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ba93888d-ed12-4743-822e-5e8b983b3923 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:15.166855 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ba93888d-ed12-4743-822e-5e8b983b3923 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:15.170595 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 51/112] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:14 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:15.177193 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ba93888d-ed12-4743-822e-5e8b983b3923 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:15.177193 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ba93888d-ed12-4743-822e-5e8b983b3923 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:15.177193 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ba93888d-ed12-4743-822e-5e8b983b3923 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:15.177193 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ba93888d-ed12-4743-822e-5e8b983b3923 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:15.183330 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a978319c-b98f-4221-b4af-3467d1ee4681 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:15.184296 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a978319c-b98f-4221-b4af-3467d1ee4681 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:15.191047 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a978319c-b98f-4221-b4af-3467d1ee4681 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:15.191497 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a978319c-b98f-4221-b4af-3467d1ee4681 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:15.192273 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a978319c-b98f-4221-b4af-3467d1ee4681 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:15.192758 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a978319c-b98f-4221-b4af-3467d1ee4681 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:15.424898 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a978319c-b98f-4221-b4af-3467d1ee4681 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:15.434346 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a978319c-b98f-4221-b4af-3467d1ee4681 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.262501 Aug 01 14:21:15.435255 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 52/113] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:15 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:15.445313 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ba93888d-ed12-4743-822e-5e8b983b3923 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:15.454861 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ba93888d-ed12-4743-822e-5e8b983b3923 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:15.456612 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ba93888d-ed12-4743-822e-5e8b983b3923 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:15.457926 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ba93888d-ed12-4743-822e-5e8b983b3923 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.297371 Aug 01 14:21:15.462799 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 62/114] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:15 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:16.188051 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ed4ce0f7-b9e5-483b-8203-5a260a62cf6e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:16.190864 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3f6aa928-d9ef-4ac3-970c-555e7e2930b1 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:16.192021 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ed4ce0f7-b9e5-483b-8203-5a260a62cf6e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:16.194518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3f6aa928-d9ef-4ac3-970c-555e7e2930b1 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:16.201345 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3f6aa928-d9ef-4ac3-970c-555e7e2930b1 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:16.202153 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ed4ce0f7-b9e5-483b-8203-5a260a62cf6e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:16.202610 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ed4ce0f7-b9e5-483b-8203-5a260a62cf6e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:16.202860 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3f6aa928-d9ef-4ac3-970c-555e7e2930b1 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:16.203439 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ed4ce0f7-b9e5-483b-8203-5a260a62cf6e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:16.204064 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3f6aa928-d9ef-4ac3-970c-555e7e2930b1 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:16.204178 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ed4ce0f7-b9e5-483b-8203-5a260a62cf6e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:16.204576 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3f6aa928-d9ef-4ac3-970c-555e7e2930b1 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:16.445957 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ed4ce0f7-b9e5-483b-8203-5a260a62cf6e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:16.451990 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3f6aa928-d9ef-4ac3-970c-555e7e2930b1 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:16.458318 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ed4ce0f7-b9e5-483b-8203-5a260a62cf6e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.273604 Aug 01 14:21:16.459838 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 63/115] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:16 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:16.469209 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3f6aa928-d9ef-4ac3-970c-555e7e2930b1 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.282049 Aug 01 14:21:16.469209 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 53/116] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:16 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:16.469544 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3a3ee6f2-e57d-4938-aa89-baba85578af6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:16.469544 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3a3ee6f2-e57d-4938-aa89-baba85578af6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:16.476932 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3a3ee6f2-e57d-4938-aa89-baba85578af6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:16.478226 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3a3ee6f2-e57d-4938-aa89-baba85578af6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:16.479309 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3a3ee6f2-e57d-4938-aa89-baba85578af6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:16.479970 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3a3ee6f2-e57d-4938-aa89-baba85578af6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:16.485093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3df50e55-4376-4dc6-9b06-76ec97a786e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:16.485822 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3df50e55-4376-4dc6-9b06-76ec97a786e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:16.496893 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3df50e55-4376-4dc6-9b06-76ec97a786e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:16.503754 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3df50e55-4376-4dc6-9b06-76ec97a786e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:16.503754 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3df50e55-4376-4dc6-9b06-76ec97a786e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:16.503754 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3df50e55-4376-4dc6-9b06-76ec97a786e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:16.707962 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3a3ee6f2-e57d-4938-aa89-baba85578af6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:16.714544 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3df50e55-4376-4dc6-9b06-76ec97a786e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:16.718533 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3a3ee6f2-e57d-4938-aa89-baba85578af6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.257420 Aug 01 14:21:16.719316 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 64/117] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:16 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:16.733515 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3df50e55-4376-4dc6-9b06-76ec97a786e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:16.733515 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3df50e55-4376-4dc6-9b06-76ec97a786e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:16.734093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3df50e55-4376-4dc6-9b06-76ec97a786e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.253494 Aug 01 14:21:16.735056 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 54/118] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:16 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:21:17.211447 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-86bd9cb4-11c7-4a3e-9c76-9496dff9804f req-bde50de0-1acf-4a49-bdbb-45e330eacf67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3824777-d8b1-4993-a19d-921e3054fde8", "name": "network-vif-plugged", "status": "completed", "tag": "fb15ef4e-abff-40a5-9a03-acfeb6c36754"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:17.258202 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-86bd9cb4-11c7-4a3e-9c76-9496dff9804f req-bde50de0-1acf-4a49-bdbb-45e330eacf67 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:17.258865 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-86bd9cb4-11c7-4a3e-9c76-9496dff9804f req-bde50de0-1acf-4a49-bdbb-45e330eacf67 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:17.289088 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-86bd9cb4-11c7-4a3e-9c76-9496dff9804f req-bde50de0-1acf-4a49-bdbb-45e330eacf67 service nova] Creating event network-vif-plugged:fb15ef4e-abff-40a5-9a03-acfeb6c36754 for instance c3824777-d8b1-4993-a19d-921e3054fde8 on hv-cinder-78729 Aug 01 14:21:17.296688 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-86bd9cb4-11c7-4a3e-9c76-9496dff9804f req-bde50de0-1acf-4a49-bdbb-45e330eacf67 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194754 Aug 01 14:21:17.297515 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 65/119] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:17.481163 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ce05f069-6e78-495e-892d-5656e148f090 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:17.482020 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ce05f069-6e78-495e-892d-5656e148f090 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:17.488569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ce05f069-6e78-495e-892d-5656e148f090 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:17.489020 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ce05f069-6e78-495e-892d-5656e148f090 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:17.489826 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ce05f069-6e78-495e-892d-5656e148f090 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:17.490990 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ce05f069-6e78-495e-892d-5656e148f090 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:17.507646 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-eb23c24d-7b86-441f-bb4c-f52b34f3999f tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:17.513219 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-eb23c24d-7b86-441f-bb4c-f52b34f3999f tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:17.538563 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-eb23c24d-7b86-441f-bb4c-f52b34f3999f tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:17.539385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-eb23c24d-7b86-441f-bb4c-f52b34f3999f tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:17.542392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-eb23c24d-7b86-441f-bb4c-f52b34f3999f tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:17.543009 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-eb23c24d-7b86-441f-bb4c-f52b34f3999f tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:17.746221 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ce05f069-6e78-495e-892d-5656e148f090 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:17.761268 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ce05f069-6e78-495e-892d-5656e148f090 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.277872 Aug 01 14:21:17.762643 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 55/120] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:17 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:17.768309 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-cb39b04b-a150-4fb2-ba18-30012d986a76 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:17.768991 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-cb39b04b-a150-4fb2-ba18-30012d986a76 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:17.788558 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cb39b04b-a150-4fb2-ba18-30012d986a76 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:17.789208 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cb39b04b-a150-4fb2-ba18-30012d986a76 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:17.790422 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cb39b04b-a150-4fb2-ba18-30012d986a76 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:17.791101 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cb39b04b-a150-4fb2-ba18-30012d986a76 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:17.796648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-eb23c24d-7b86-441f-bb4c-f52b34f3999f tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:17.805722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-eb23c24d-7b86-441f-bb4c-f52b34f3999f tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.309602 Aug 01 14:21:17.808044 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 66/121] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:17 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:17.820265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-82b1c16c-087b-437c-a760-33c7c899d6f7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:17.821065 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-82b1c16c-087b-437c-a760-33c7c899d6f7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:17.827906 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-82b1c16c-087b-437c-a760-33c7c899d6f7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:17.828352 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-82b1c16c-087b-437c-a760-33c7c899d6f7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:17.829652 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-82b1c16c-087b-437c-a760-33c7c899d6f7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:17.830118 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-82b1c16c-087b-437c-a760-33c7c899d6f7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:18.118630 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-82b1c16c-087b-437c-a760-33c7c899d6f7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:18.133244 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-cb39b04b-a150-4fb2-ba18-30012d986a76 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:18.135148 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-82b1c16c-087b-437c-a760-33c7c899d6f7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:18.137061 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-82b1c16c-087b-437c-a760-33c7c899d6f7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:18.138413 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-82b1c16c-087b-437c-a760-33c7c899d6f7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.329227 Aug 01 14:21:18.139490 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 67/122] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:17 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:18.143400 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-cb39b04b-a150-4fb2-ba18-30012d986a76 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.379333 Aug 01 14:21:18.144446 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 56/123] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:17 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:18.783144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c4a76099-659a-4516-84ec-1ea5938b9cf5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:18.784275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c4a76099-659a-4516-84ec-1ea5938b9cf5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:18.795876 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c4a76099-659a-4516-84ec-1ea5938b9cf5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:18.798325 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c4a76099-659a-4516-84ec-1ea5938b9cf5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:18.798325 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c4a76099-659a-4516-84ec-1ea5938b9cf5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:18.798325 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c4a76099-659a-4516-84ec-1ea5938b9cf5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:18.831499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-962c8866-67c9-4e19-9b73-50c7d4a77e14 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:18.832196 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-962c8866-67c9-4e19-9b73-50c7d4a77e14 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:18.850553 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-962c8866-67c9-4e19-9b73-50c7d4a77e14 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:18.851227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-962c8866-67c9-4e19-9b73-50c7d4a77e14 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:18.852696 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-962c8866-67c9-4e19-9b73-50c7d4a77e14 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:18.853356 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-962c8866-67c9-4e19-9b73-50c7d4a77e14 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:19.023719 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c4a76099-659a-4516-84ec-1ea5938b9cf5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:19.032651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c4a76099-659a-4516-84ec-1ea5938b9cf5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.252703 Aug 01 14:21:19.033670 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 68/124] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:18 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:19.073639 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-962c8866-67c9-4e19-9b73-50c7d4a77e14 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:19.081181 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-962c8866-67c9-4e19-9b73-50c7d4a77e14 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.255751 Aug 01 14:21:19.081835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 57/125] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:18 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:19.165063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ab794daf-2802-457d-8873-0a95fa1688fc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:19.165538 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0f649a79-a30e-451c-96ab-37e27d0e2959 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:19.165681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ab794daf-2802-457d-8873-0a95fa1688fc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:19.166179 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0f649a79-a30e-451c-96ab-37e27d0e2959 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:19.171780 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ab794daf-2802-457d-8873-0a95fa1688fc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:19.172178 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0f649a79-a30e-451c-96ab-37e27d0e2959 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:19.172341 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ab794daf-2802-457d-8873-0a95fa1688fc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:19.172627 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0f649a79-a30e-451c-96ab-37e27d0e2959 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:19.172968 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ab794daf-2802-457d-8873-0a95fa1688fc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:19.173393 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0f649a79-a30e-451c-96ab-37e27d0e2959 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:19.173560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ab794daf-2802-457d-8873-0a95fa1688fc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:19.173876 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0f649a79-a30e-451c-96ab-37e27d0e2959 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:19.392363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ab794daf-2802-457d-8873-0a95fa1688fc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:19.403820 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ab794daf-2802-457d-8873-0a95fa1688fc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.241945 Aug 01 14:21:19.403820 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 69/126] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:19 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:19.438801 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0f649a79-a30e-451c-96ab-37e27d0e2959 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:19.450318 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0f649a79-a30e-451c-96ab-37e27d0e2959 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:19.452581 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0f649a79-a30e-451c-96ab-37e27d0e2959 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:19.453770 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0f649a79-a30e-451c-96ab-37e27d0e2959 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.293270 Aug 01 14:21:19.456090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 58/127] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:19 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:19.570262 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-c7629fff-8e9d-4401-9e5d-938b06db42de req-a755ceeb-afb3-4f72-9584-c1037ec69881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e", "name": "network-vif-plugged", "status": "completed", "tag": "38972512-acb0-4637-b22c-a3933134341b"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:19.582017 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-c7629fff-8e9d-4401-9e5d-938b06db42de req-a755ceeb-afb3-4f72-9584-c1037ec69881 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:19.582998 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-c7629fff-8e9d-4401-9e5d-938b06db42de req-a755ceeb-afb3-4f72-9584-c1037ec69881 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:19.619923 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-c7629fff-8e9d-4401-9e5d-938b06db42de req-a755ceeb-afb3-4f72-9584-c1037ec69881 service nova] Creating event network-vif-plugged:38972512-acb0-4637-b22c-a3933134341b for instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e on hv-cinder-78729 Aug 01 14:21:19.619923 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-c7629fff-8e9d-4401-9e5d-938b06db42de req-a755ceeb-afb3-4f72-9584-c1037ec69881 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055411 Aug 01 14:21:19.619923 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 70/128] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:20.055449 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-40e20b3b-a4e9-4248-b963-8dd06aaf1b51 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:20.056979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-40e20b3b-a4e9-4248-b963-8dd06aaf1b51 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:20.071413 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-40e20b3b-a4e9-4248-b963-8dd06aaf1b51 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:20.071969 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-40e20b3b-a4e9-4248-b963-8dd06aaf1b51 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:20.074267 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-40e20b3b-a4e9-4248-b963-8dd06aaf1b51 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:20.074777 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-40e20b3b-a4e9-4248-b963-8dd06aaf1b51 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:20.104360 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-cb6b56fa-44d0-4107-b6f3-223756bfc845 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:20.105329 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-cb6b56fa-44d0-4107-b6f3-223756bfc845 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:20.121027 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cb6b56fa-44d0-4107-b6f3-223756bfc845 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:20.127792 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cb6b56fa-44d0-4107-b6f3-223756bfc845 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:20.127792 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cb6b56fa-44d0-4107-b6f3-223756bfc845 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:20.127792 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cb6b56fa-44d0-4107-b6f3-223756bfc845 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:20.324266 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-40e20b3b-a4e9-4248-b963-8dd06aaf1b51 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:20.332431 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-40e20b3b-a4e9-4248-b963-8dd06aaf1b51 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.281556 Aug 01 14:21:20.333269 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 59/129] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:20 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:20.356210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-cb6b56fa-44d0-4107-b6f3-223756bfc845 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:20.363686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-cb6b56fa-44d0-4107-b6f3-223756bfc845 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.264615 Aug 01 14:21:20.364250 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 71/130] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:20 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:20.425327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f067030e-7c59-4992-9109-eebe726143c0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:20.426290 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f067030e-7c59-4992-9109-eebe726143c0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:20.433863 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f067030e-7c59-4992-9109-eebe726143c0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:20.434316 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f067030e-7c59-4992-9109-eebe726143c0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:20.439371 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f067030e-7c59-4992-9109-eebe726143c0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:20.439371 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f067030e-7c59-4992-9109-eebe726143c0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:20.486859 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b843f59a-3bfb-437f-bb1b-3bdd62901850 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:20.487627 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b843f59a-3bfb-437f-bb1b-3bdd62901850 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:20.501580 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b843f59a-3bfb-437f-bb1b-3bdd62901850 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:20.502071 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b843f59a-3bfb-437f-bb1b-3bdd62901850 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:20.502862 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b843f59a-3bfb-437f-bb1b-3bdd62901850 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:20.503315 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b843f59a-3bfb-437f-bb1b-3bdd62901850 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:20.641711 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f067030e-7c59-4992-9109-eebe726143c0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:20.667625 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f067030e-7c59-4992-9109-eebe726143c0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.246587 Aug 01 14:21:20.669667 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 60/131] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:20 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:20.694568 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-b843f59a-3bfb-437f-bb1b-3bdd62901850 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:20.702973 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-b843f59a-3bfb-437f-bb1b-3bdd62901850 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:20.704859 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-b843f59a-3bfb-437f-bb1b-3bdd62901850 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:20.705612 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b843f59a-3bfb-437f-bb1b-3bdd62901850 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.223133 Aug 01 14:21:20.717838 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 72/132] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:20 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:21:21.355364 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ee6564a6-b394-4bcf-b6d7-88053a36312f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:21.355972 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ee6564a6-b394-4bcf-b6d7-88053a36312f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:21.362146 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ee6564a6-b394-4bcf-b6d7-88053a36312f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:21.362597 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ee6564a6-b394-4bcf-b6d7-88053a36312f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:21.363358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ee6564a6-b394-4bcf-b6d7-88053a36312f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:21.363849 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ee6564a6-b394-4bcf-b6d7-88053a36312f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:21.386814 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-13991f7b-2c6d-4d1f-96d8-cf5ceee4e794 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:21.387649 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-13991f7b-2c6d-4d1f-96d8-cf5ceee4e794 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:21.394341 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-13991f7b-2c6d-4d1f-96d8-cf5ceee4e794 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:21.394788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-13991f7b-2c6d-4d1f-96d8-cf5ceee4e794 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:21.395737 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-13991f7b-2c6d-4d1f-96d8-cf5ceee4e794 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:21.396181 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-13991f7b-2c6d-4d1f-96d8-cf5ceee4e794 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:21.600632 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ee6564a6-b394-4bcf-b6d7-88053a36312f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:21.606759 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-13991f7b-2c6d-4d1f-96d8-cf5ceee4e794 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:21.611086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ee6564a6-b394-4bcf-b6d7-88053a36312f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.259461 Aug 01 14:21:21.611703 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 61/133] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:21 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:21.612960 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-13991f7b-2c6d-4d1f-96d8-cf5ceee4e794 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1315 microversion: 2.1 time: 0.229946 Aug 01 14:21:21.613543 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 73/134] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:21 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:21.642659 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-ffc70b42-7ea8-40b8-bd8f-0e18a6e43d2b req-f499eebe-578e-4f02-955e-d7cd4a961929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4eb6448-faf6-4409-bc4d-591b29ab2e52", "name": "network-vif-plugged", "status": "completed", "tag": "08093b92-1518-49dd-ab00-5865b4e9fb4f"}, {"server_uuid": "9c41c564-40f2-47cf-820b-915c3d43ccb3", "name": "network-vif-plugged", "status": "completed", "tag": "bc816aff-9768-4c40-a6d1-adb40e9ce6a1"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:21.656581 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-ffc70b42-7ea8-40b8-bd8f-0e18a6e43d2b req-f499eebe-578e-4f02-955e-d7cd4a961929 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:21.656581 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-ffc70b42-7ea8-40b8-bd8f-0e18a6e43d2b req-f499eebe-578e-4f02-955e-d7cd4a961929 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:21.672493 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-ffc70b42-7ea8-40b8-bd8f-0e18a6e43d2b req-f499eebe-578e-4f02-955e-d7cd4a961929 service nova] Creating event network-vif-plugged:08093b92-1518-49dd-ab00-5865b4e9fb4f for instance b4eb6448-faf6-4409-bc4d-591b29ab2e52 on hv-cinder-78729 Aug 01 14:21:21.673251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-ffc70b42-7ea8-40b8-bd8f-0e18a6e43d2b req-f499eebe-578e-4f02-955e-d7cd4a961929 service nova] Creating event network-vif-plugged:bc816aff-9768-4c40-a6d1-adb40e9ce6a1 for instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 on hv-cinder-78729 Aug 01 14:21:21.681395 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-ffc70b42-7ea8-40b8-bd8f-0e18a6e43d2b req-f499eebe-578e-4f02-955e-d7cd4a961929 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042337 Aug 01 14:21:21.682060 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 62/135] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:21.694049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-6d15902a-7ab2-446a-83b1-479ba2a90a43 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:21.694683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-6d15902a-7ab2-446a-83b1-479ba2a90a43 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:21.701161 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6d15902a-7ab2-446a-83b1-479ba2a90a43 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:21.705708 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6d15902a-7ab2-446a-83b1-479ba2a90a43 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:21.705708 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6d15902a-7ab2-446a-83b1-479ba2a90a43 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:21.705708 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6d15902a-7ab2-446a-83b1-479ba2a90a43 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:21.738039 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a91193f2-c823-4458-8733-f9b33013a9cc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:21.739288 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a91193f2-c823-4458-8733-f9b33013a9cc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:21.749808 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a91193f2-c823-4458-8733-f9b33013a9cc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:21.750282 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a91193f2-c823-4458-8733-f9b33013a9cc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:21.751120 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a91193f2-c823-4458-8733-f9b33013a9cc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:21.751559 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a91193f2-c823-4458-8733-f9b33013a9cc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:21.937092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-6d15902a-7ab2-446a-83b1-479ba2a90a43 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:21.961050 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-6d15902a-7ab2-446a-83b1-479ba2a90a43 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.271350 Aug 01 14:21:21.962662 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a91193f2-c823-4458-8733-f9b33013a9cc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:21.978566 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 74/136] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:21 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:21.996872 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a91193f2-c823-4458-8733-f9b33013a9cc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:21.998864 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a91193f2-c823-4458-8733-f9b33013a9cc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:22.001077 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a91193f2-c823-4458-8733-f9b33013a9cc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.272696 Aug 01 14:21:22.002653 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 63/137] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:21 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:22.631944 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d14da0a5-9c4d-4db4-bf4a-4731e5ba4102 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:22.632559 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d14da0a5-9c4d-4db4-bf4a-4731e5ba4102 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:22.635773 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a65d8ba4-b4ea-432b-b96a-97813a4b1571 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:22.636390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a65d8ba4-b4ea-432b-b96a-97813a4b1571 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:22.638982 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d14da0a5-9c4d-4db4-bf4a-4731e5ba4102 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.639431 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d14da0a5-9c4d-4db4-bf4a-4731e5ba4102 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:22.640198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d14da0a5-9c4d-4db4-bf4a-4731e5ba4102 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.640634 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d14da0a5-9c4d-4db4-bf4a-4731e5ba4102 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:22.642725 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a65d8ba4-b4ea-432b-b96a-97813a4b1571 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.643181 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a65d8ba4-b4ea-432b-b96a-97813a4b1571 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:22.643952 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a65d8ba4-b4ea-432b-b96a-97813a4b1571 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.644389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a65d8ba4-b4ea-432b-b96a-97813a4b1571 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:22.869225 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d14da0a5-9c4d-4db4-bf4a-4731e5ba4102 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:22.871611 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a65d8ba4-b4ea-432b-b96a-97813a4b1571 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:22.873510 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=100 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:22.878804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d14da0a5-9c4d-4db4-bf4a-4731e5ba4102 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1321 microversion: 2.1 time: 0.251221 Aug 01 14:21:22.879597 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 75/138] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:22 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:22.885241 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a65d8ba4-b4ea-432b-b96a-97813a4b1571 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1503 microversion: 2.1 time: 0.253384 Aug 01 14:21:22.887012 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 64/139] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:22 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:22.992087 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-52323cd5-ba5d-4006-b1c3-a4d81e1ae8d9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:22.992087 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-52323cd5-ba5d-4006-b1c3-a4d81e1ae8d9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:22.994297 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-52323cd5-ba5d-4006-b1c3-a4d81e1ae8d9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.995021 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-52323cd5-ba5d-4006-b1c3-a4d81e1ae8d9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:22.995808 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-52323cd5-ba5d-4006-b1c3-a4d81e1ae8d9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.996319 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-52323cd5-ba5d-4006-b1c3-a4d81e1ae8d9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:23.028766 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-efd9bd43-b7cb-433d-9a4b-8379601791b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:23.029390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-efd9bd43-b7cb-433d-9a4b-8379601791b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:23.040713 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-efd9bd43-b7cb-433d-9a4b-8379601791b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:23.043138 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-efd9bd43-b7cb-433d-9a4b-8379601791b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:23.044488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-efd9bd43-b7cb-433d-9a4b-8379601791b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:23.044929 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-efd9bd43-b7cb-433d-9a4b-8379601791b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:23.079150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=100 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:23.272664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-52323cd5-ba5d-4006-b1c3-a4d81e1ae8d9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:23.282612 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-52323cd5-ba5d-4006-b1c3-a4d81e1ae8d9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.300165 Aug 01 14:21:23.283273 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 76/140] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:22 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:23.309176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-efd9bd43-b7cb-433d-9a4b-8379601791b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:23.317387 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-efd9bd43-b7cb-433d-9a4b-8379601791b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:23.319566 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-efd9bd43-b7cb-433d-9a4b-8379601791b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:23.320668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-efd9bd43-b7cb-433d-9a4b-8379601791b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.299709 Aug 01 14:21:23.321303 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 65/141] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:23 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:23.699373 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-dbddb5eb-4b8a-4787-9e0b-9679ea99bde7 req-088fb543-9f0b-4713-bcf7-f17457034713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb5f425-d747-41d4-bed5-211a5d80e32b", "name": "network-vif-plugged", "status": "completed", "tag": "5314437c-b6c2-401f-b4c2-178a92e38017"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:23.710521 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-dbddb5eb-4b8a-4787-9e0b-9679ea99bde7 req-088fb543-9f0b-4713-bcf7-f17457034713 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:23.711105 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-dbddb5eb-4b8a-4787-9e0b-9679ea99bde7 req-088fb543-9f0b-4713-bcf7-f17457034713 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:23.722736 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-dbddb5eb-4b8a-4787-9e0b-9679ea99bde7 req-088fb543-9f0b-4713-bcf7-f17457034713 service nova] Creating event network-vif-plugged:5314437c-b6c2-401f-b4c2-178a92e38017 for instance 2eb5f425-d747-41d4-bed5-211a5d80e32b on hv-cinder-78729 Aug 01 14:21:23.728925 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-dbddb5eb-4b8a-4787-9e0b-9679ea99bde7 req-088fb543-9f0b-4713-bcf7-f17457034713 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034630 Aug 01 14:21:23.729560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 77/142] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:23.900914 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f019f612-22da-4bb1-a511-4469df9d6b71 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:23.901834 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f019f612-22da-4bb1-a511-4469df9d6b71 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:23.908665 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f019f612-22da-4bb1-a511-4469df9d6b71 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:23.909210 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f019f612-22da-4bb1-a511-4469df9d6b71 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:23.910127 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f019f612-22da-4bb1-a511-4469df9d6b71 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:23.911028 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f019f612-22da-4bb1-a511-4469df9d6b71 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:24.085130 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f019f612-22da-4bb1-a511-4469df9d6b71 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:24.093451 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f019f612-22da-4bb1-a511-4469df9d6b71 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1515 microversion: 2.1 time: 0.196812 Aug 01 14:21:24.094169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 66/143] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:23 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:24.125948 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b788a90a-dca9-4d62-9ce2-c86c4c5f630b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:24.125948 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b788a90a-dca9-4d62-9ce2-c86c4c5f630b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:24.131917 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b788a90a-dca9-4d62-9ce2-c86c4c5f630b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:24.132421 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b788a90a-dca9-4d62-9ce2-c86c4c5f630b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:24.133211 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b788a90a-dca9-4d62-9ce2-c86c4c5f630b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:24.133648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b788a90a-dca9-4d62-9ce2-c86c4c5f630b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:24.234494 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-b788a90a-dca9-4d62-9ce2-c86c4c5f630b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lazy-loading 'flavor' on Instance uuid b4eb6448-faf6-4409-bc4d-591b29ab2e52 {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:21:24.304644 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-97f2d1bb-a2cc-4726-b18a-58dee29b909f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:24.305251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-97f2d1bb-a2cc-4726-b18a-58dee29b909f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:24.311273 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-97f2d1bb-a2cc-4726-b18a-58dee29b909f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:24.311979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-97f2d1bb-a2cc-4726-b18a-58dee29b909f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:24.313004 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-97f2d1bb-a2cc-4726-b18a-58dee29b909f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:24.313468 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-97f2d1bb-a2cc-4726-b18a-58dee29b909f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:24.447371 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-97f2d1bb-a2cc-4726-b18a-58dee29b909f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:24.455315 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-97f2d1bb-a2cc-4726-b18a-58dee29b909f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.154363 Aug 01 14:21:24.455689 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 67/144] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:24 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:24.460656 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-9936479b-11de-4286-bdbf-346258ff2757 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:24.464384 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-9936479b-11de-4286-bdbf-346258ff2757 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:24.467469 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9936479b-11de-4286-bdbf-346258ff2757 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:24.468063 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9936479b-11de-4286-bdbf-346258ff2757 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:24.468962 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9936479b-11de-4286-bdbf-346258ff2757 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:24.469406 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9936479b-11de-4286-bdbf-346258ff2757 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:24.568705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b788a90a-dca9-4d62-9ce2-c86c4c5f630b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "POST /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52/action" status: 200 len: 32 microversion: 2.1 time: 0.452781 Aug 01 14:21:24.569336 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 78/145] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Aug 1 14:21:24 2022] POST /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52/action => generated 32 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:21:24.579271 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4fa708c2-b69c-49b4-9a59-1c092098b3f9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:24.579970 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4fa708c2-b69c-49b4-9a59-1c092098b3f9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:24.586648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4fa708c2-b69c-49b4-9a59-1c092098b3f9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:24.587116 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4fa708c2-b69c-49b4-9a59-1c092098b3f9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:24.587897 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4fa708c2-b69c-49b4-9a59-1c092098b3f9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:24.588326 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4fa708c2-b69c-49b4-9a59-1c092098b3f9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:24.608726 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-9936479b-11de-4286-bdbf-346258ff2757 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:24.619296 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-9936479b-11de-4286-bdbf-346258ff2757 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:24.621120 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-9936479b-11de-4286-bdbf-346258ff2757 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:24.623663 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-9936479b-11de-4286-bdbf-346258ff2757 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.166426 Aug 01 14:21:24.624585 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 68/146] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:24 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:24.745581 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4fa708c2-b69c-49b4-9a59-1c092098b3f9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:24.753482 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4fa708c2-b69c-49b4-9a59-1c092098b3f9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.178303 Aug 01 14:21:24.754103 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 79/147] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:24 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:25.476895 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-caa51973-ef72-4ffc-9bb6-ea549f8f844e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:25.477428 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-caa51973-ef72-4ffc-9bb6-ea549f8f844e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:25.483619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-caa51973-ef72-4ffc-9bb6-ea549f8f844e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:25.484063 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-caa51973-ef72-4ffc-9bb6-ea549f8f844e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:25.484867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-caa51973-ef72-4ffc-9bb6-ea549f8f844e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:25.485329 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-caa51973-ef72-4ffc-9bb6-ea549f8f844e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:25.620736 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-caa51973-ef72-4ffc-9bb6-ea549f8f844e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:25.628285 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-caa51973-ef72-4ffc-9bb6-ea549f8f844e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.155594 Aug 01 14:21:25.633176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 69/148] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:25 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:25.648390 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-bdbf01ea-4bb6-499c-85ba-133313fccf5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:25.649003 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-bdbf01ea-4bb6-499c-85ba-133313fccf5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:25.655262 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bdbf01ea-4bb6-499c-85ba-133313fccf5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:25.655730 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bdbf01ea-4bb6-499c-85ba-133313fccf5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:25.656759 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bdbf01ea-4bb6-499c-85ba-133313fccf5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:25.657250 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bdbf01ea-4bb6-499c-85ba-133313fccf5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:25.777053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-bd72c1aa-0296-4683-a565-9c4b90222b58 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:25.777852 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-bd72c1aa-0296-4683-a565-9c4b90222b58 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:25.793871 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bd72c1aa-0296-4683-a565-9c4b90222b58 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:25.794362 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bd72c1aa-0296-4683-a565-9c4b90222b58 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:25.795233 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bd72c1aa-0296-4683-a565-9c4b90222b58 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:25.795767 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bd72c1aa-0296-4683-a565-9c4b90222b58 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:25.796803 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-bdbf01ea-4bb6-499c-85ba-133313fccf5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:25.805818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-bdbf01ea-4bb6-499c-85ba-133313fccf5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:25.807569 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-bdbf01ea-4bb6-499c-85ba-133313fccf5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:25.808706 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-bdbf01ea-4bb6-499c-85ba-133313fccf5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.164919 Aug 01 14:21:25.809244 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 80/149] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:25 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:25.930328 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bd72c1aa-0296-4683-a565-9c4b90222b58 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:25.937793 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-bd72c1aa-0296-4683-a565-9c4b90222b58 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.166276 Aug 01 14:21:25.938368 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 70/150] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:25 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:26.650071 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-dd59d28c-3a6a-423e-9687-cc25f3743a48 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:26.650615 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-dd59d28c-3a6a-423e-9687-cc25f3743a48 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:26.656831 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dd59d28c-3a6a-423e-9687-cc25f3743a48 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:26.657292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dd59d28c-3a6a-423e-9687-cc25f3743a48 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:26.658085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dd59d28c-3a6a-423e-9687-cc25f3743a48 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:26.658531 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dd59d28c-3a6a-423e-9687-cc25f3743a48 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:26.793570 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-dd59d28c-3a6a-423e-9687-cc25f3743a48 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:26.800992 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-dd59d28c-3a6a-423e-9687-cc25f3743a48 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.155601 Aug 01 14:21:26.801566 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 81/151] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:26 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:26.831318 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b526a2f5-9c51-4794-966d-cf4cd29099cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:26.832388 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b526a2f5-9c51-4794-966d-cf4cd29099cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:26.840221 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b526a2f5-9c51-4794-966d-cf4cd29099cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:26.840667 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b526a2f5-9c51-4794-966d-cf4cd29099cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:26.841430 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b526a2f5-9c51-4794-966d-cf4cd29099cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:26.841892 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b526a2f5-9c51-4794-966d-cf4cd29099cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:26.958780 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-311d2d96-6e1a-497f-9ff9-307b6aef1672 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:26.960147 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-311d2d96-6e1a-497f-9ff9-307b6aef1672 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:26.966826 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-311d2d96-6e1a-497f-9ff9-307b6aef1672 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:26.967283 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-311d2d96-6e1a-497f-9ff9-307b6aef1672 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:26.968049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-311d2d96-6e1a-497f-9ff9-307b6aef1672 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:26.968487 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-311d2d96-6e1a-497f-9ff9-307b6aef1672 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:26.976858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b526a2f5-9c51-4794-966d-cf4cd29099cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:26.985185 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b526a2f5-9c51-4794-966d-cf4cd29099cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:26.986940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b526a2f5-9c51-4794-966d-cf4cd29099cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:26.988172 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b526a2f5-9c51-4794-966d-cf4cd29099cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1407 microversion: 2.20 time: 0.160817 Aug 01 14:21:26.988803 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 71/152] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:26 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:27.102232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-311d2d96-6e1a-497f-9ff9-307b6aef1672 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:27.109543 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-311d2d96-6e1a-497f-9ff9-307b6aef1672 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.154644 Aug 01 14:21:27.110141 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 82/153] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:26 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:27.823156 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a24035e2-3e4b-46c4-9704-aa37f768b949 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:27.823777 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a24035e2-3e4b-46c4-9704-aa37f768b949 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:27.830273 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a24035e2-3e4b-46c4-9704-aa37f768b949 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:27.830858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a24035e2-3e4b-46c4-9704-aa37f768b949 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:27.831629 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a24035e2-3e4b-46c4-9704-aa37f768b949 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:27.832159 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a24035e2-3e4b-46c4-9704-aa37f768b949 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:27.975675 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a24035e2-3e4b-46c4-9704-aa37f768b949 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:27.983215 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a24035e2-3e4b-46c4-9704-aa37f768b949 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.164125 Aug 01 14:21:27.983782 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 72/154] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:27 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:28.012051 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-346cfda4-9369-4b2c-ab3d-40a6a3b343ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:28.016715 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-346cfda4-9369-4b2c-ab3d-40a6a3b343ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:28.023645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-346cfda4-9369-4b2c-ab3d-40a6a3b343ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:28.024102 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-346cfda4-9369-4b2c-ab3d-40a6a3b343ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:28.024880 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-346cfda4-9369-4b2c-ab3d-40a6a3b343ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:28.025321 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-346cfda4-9369-4b2c-ab3d-40a6a3b343ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:28.130986 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7e397883-39be-444f-a2e2-6b83bf65eda3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:28.131713 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7e397883-39be-444f-a2e2-6b83bf65eda3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:28.137926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7e397883-39be-444f-a2e2-6b83bf65eda3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:28.138378 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7e397883-39be-444f-a2e2-6b83bf65eda3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:28.139168 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7e397883-39be-444f-a2e2-6b83bf65eda3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:28.139723 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7e397883-39be-444f-a2e2-6b83bf65eda3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:28.157347 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-346cfda4-9369-4b2c-ab3d-40a6a3b343ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:28.166956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-346cfda4-9369-4b2c-ab3d-40a6a3b343ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:28.168638 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-346cfda4-9369-4b2c-ab3d-40a6a3b343ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:28.169917 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-346cfda4-9369-4b2c-ab3d-40a6a3b343ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1599 microversion: 2.20 time: 0.161684 Aug 01 14:21:28.170542 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 83/155] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:28 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:21:28.194291 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-26ca6213-c191-41ce-9fd2-77e73f731527 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:28.194788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-26ca6213-c191-41ce-9fd2-77e73f731527 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:28.201100 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-26ca6213-c191-41ce-9fd2-77e73f731527 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:28.201674 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-26ca6213-c191-41ce-9fd2-77e73f731527 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:28.202467 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-26ca6213-c191-41ce-9fd2-77e73f731527 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:28.202901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-26ca6213-c191-41ce-9fd2-77e73f731527 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:28.310975 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-26ca6213-c191-41ce-9fd2-77e73f731527 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.121064 Aug 01 14:21:28.314225 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 84/156] 10.222.0.49 () {60 vars in 1316 bytes} [Mon Aug 1 14:21:28 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:21:28.321554 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7e397883-39be-444f-a2e2-6b83bf65eda3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:28.330483 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7e397883-39be-444f-a2e2-6b83bf65eda3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.203479 Aug 01 14:21:28.331058 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 73/157] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:28 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:28.364939 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e63bd921-2234-4b9d-91ea-d8a62a72cea9 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b603dc76-272b-4cd5-98f2-0a74c3f1bf02"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:28.367708 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e63bd921-2234-4b9d-91ea-d8a62a72cea9 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:28.374316 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e63bd921-2234-4b9d-91ea-d8a62a72cea9 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:28.374946 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e63bd921-2234-4b9d-91ea-d8a62a72cea9 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:28.375739 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e63bd921-2234-4b9d-91ea-d8a62a72cea9 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:28.376204 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e63bd921-2234-4b9d-91ea-d8a62a72cea9 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:29.004579 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-5a1664b0-9c2d-405b-905b-d997fab62944 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:29.005156 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-5a1664b0-9c2d-405b-905b-d997fab62944 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:29.012264 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5a1664b0-9c2d-405b-905b-d997fab62944 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:29.013013 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5a1664b0-9c2d-405b-905b-d997fab62944 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:29.014371 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5a1664b0-9c2d-405b-905b-d997fab62944 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:29.016711 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5a1664b0-9c2d-405b-905b-d997fab62944 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:29.159495 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-5a1664b0-9c2d-405b-905b-d997fab62944 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:29.168922 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-5a1664b0-9c2d-405b-905b-d997fab62944 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.168211 Aug 01 14:21:29.183955 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 74/158] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:28 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:29.353267 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-44612a18-7537-4ef5-9ab5-d49a5b6491b2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:29.354014 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-44612a18-7537-4ef5-9ab5-d49a5b6491b2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:29.355969 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=95 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:29.360906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-44612a18-7537-4ef5-9ab5-d49a5b6491b2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:29.361353 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-44612a18-7537-4ef5-9ab5-d49a5b6491b2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:29.362163 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-44612a18-7537-4ef5-9ab5-d49a5b6491b2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:29.362601 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-44612a18-7537-4ef5-9ab5-d49a5b6491b2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:29.510391 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-44612a18-7537-4ef5-9ab5-d49a5b6491b2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:29.518242 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-44612a18-7537-4ef5-9ab5-d49a5b6491b2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.169599 Aug 01 14:21:29.518995 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 75/159] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:29 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:29.843377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-b7c9f5ca-159b-4318-b4da-f0e4599ca75f req-6bbf1c36-da43-46d4-b686-142a8bafa584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c41c564-40f2-47cf-820b-915c3d43ccb3", "tag": "bc816aff-9768-4c40-a6d1-adb40e9ce6a1"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:29.853040 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-b7c9f5ca-159b-4318-b4da-f0e4599ca75f req-6bbf1c36-da43-46d4-b686-142a8bafa584 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:29.853490 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-b7c9f5ca-159b-4318-b4da-f0e4599ca75f req-6bbf1c36-da43-46d4-b686-142a8bafa584 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:29.864735 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-b7c9f5ca-159b-4318-b4da-f0e4599ca75f req-6bbf1c36-da43-46d4-b686-142a8bafa584 service nova] Creating event network-changed:bc816aff-9768-4c40-a6d1-adb40e9ce6a1 for instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 on hv-cinder-78729 Aug 01 14:21:29.871736 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-b7c9f5ca-159b-4318-b4da-f0e4599ca75f req-6bbf1c36-da43-46d4-b686-142a8bafa584 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030923 Aug 01 14:21:29.871736 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 76/160] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:21:30.192480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-caf7f02a-0c5f-4976-a8b8-df8200ef35b2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:30.194083 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-caf7f02a-0c5f-4976-a8b8-df8200ef35b2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:30.200897 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-caf7f02a-0c5f-4976-a8b8-df8200ef35b2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:30.200897 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-caf7f02a-0c5f-4976-a8b8-df8200ef35b2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:30.201938 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-caf7f02a-0c5f-4976-a8b8-df8200ef35b2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:30.202090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-caf7f02a-0c5f-4976-a8b8-df8200ef35b2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:30.354764 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-caf7f02a-0c5f-4976-a8b8-df8200ef35b2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:30.362705 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-caf7f02a-0c5f-4976-a8b8-df8200ef35b2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.175518 Aug 01 14:21:30.364485 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 77/161] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:30 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:30.541344 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-50d9286f-e420-4237-a32f-6a4676d5ce45 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:30.542027 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-50d9286f-e420-4237-a32f-6a4676d5ce45 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:30.549790 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-50d9286f-e420-4237-a32f-6a4676d5ce45 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:30.550378 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-50d9286f-e420-4237-a32f-6a4676d5ce45 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:30.551337 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-50d9286f-e420-4237-a32f-6a4676d5ce45 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:30.551874 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-50d9286f-e420-4237-a32f-6a4676d5ce45 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:30.732412 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-50d9286f-e420-4237-a32f-6a4676d5ce45 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:30.744626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-50d9286f-e420-4237-a32f-6a4676d5ce45 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.207878 Aug 01 14:21:30.745363 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 78/162] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:30 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:31.402748 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-48c995c1-d774-4363-8814-5a99db7e22bc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:31.403442 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-48c995c1-d774-4363-8814-5a99db7e22bc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:31.410113 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-48c995c1-d774-4363-8814-5a99db7e22bc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:31.410445 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-48c995c1-d774-4363-8814-5a99db7e22bc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:31.419261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-48c995c1-d774-4363-8814-5a99db7e22bc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:31.419791 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-48c995c1-d774-4363-8814-5a99db7e22bc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:31.601478 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-48c995c1-d774-4363-8814-5a99db7e22bc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:31.613629 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-48c995c1-d774-4363-8814-5a99db7e22bc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.216175 Aug 01 14:21:31.614919 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 79/163] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:31 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:31.766896 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ba476211-fcd7-4a2d-93a9-29968f028aa0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:31.767704 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ba476211-fcd7-4a2d-93a9-29968f028aa0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:31.774356 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ba476211-fcd7-4a2d-93a9-29968f028aa0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:31.774892 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ba476211-fcd7-4a2d-93a9-29968f028aa0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:31.775767 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ba476211-fcd7-4a2d-93a9-29968f028aa0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:31.776275 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ba476211-fcd7-4a2d-93a9-29968f028aa0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:31.793746 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e63bd921-2234-4b9d-91ea-d8a62a72cea9 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "POST /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.432582 Aug 01 14:21:31.800082 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 85/164] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Aug 1 14:21:28 2022] POST /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e/os-volume_attachments => generated 194 bytes in 3440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:31.923954 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ba476211-fcd7-4a2d-93a9-29968f028aa0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:31.925049 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ba476211-fcd7-4a2d-93a9-29968f028aa0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.162381 Aug 01 14:21:31.925619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 80/165] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:31 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:32.640917 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f06bc431-8719-47f9-97a9-cfe2b6059068 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:32.641622 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f06bc431-8719-47f9-97a9-cfe2b6059068 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:32.643784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=99 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:32.650513 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f06bc431-8719-47f9-97a9-cfe2b6059068 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:32.650953 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f06bc431-8719-47f9-97a9-cfe2b6059068 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:32.660707 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f06bc431-8719-47f9-97a9-cfe2b6059068 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:32.660707 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f06bc431-8719-47f9-97a9-cfe2b6059068 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:32.793974 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f06bc431-8719-47f9-97a9-cfe2b6059068 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:32.801678 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f06bc431-8719-47f9-97a9-cfe2b6059068 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.165484 Aug 01 14:21:32.804165 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 86/166] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:32 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:32.945941 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0d0cc229-0792-42a7-959f-0ce94718e7a5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:32.946609 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0d0cc229-0792-42a7-959f-0ce94718e7a5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:32.952720 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0d0cc229-0792-42a7-959f-0ce94718e7a5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:32.953168 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0d0cc229-0792-42a7-959f-0ce94718e7a5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:32.953982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0d0cc229-0792-42a7-959f-0ce94718e7a5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:32.954413 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0d0cc229-0792-42a7-959f-0ce94718e7a5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:33.097331 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0d0cc229-0792-42a7-959f-0ce94718e7a5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:33.105447 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0d0cc229-0792-42a7-959f-0ce94718e7a5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.163872 Aug 01 14:21:33.106061 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 81/167] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:32 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:33.823778 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ec7ee060-1541-46f1-bcaf-84dd46ae06dc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:33.824397 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ec7ee060-1541-46f1-bcaf-84dd46ae06dc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:33.830864 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ec7ee060-1541-46f1-bcaf-84dd46ae06dc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:33.831321 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ec7ee060-1541-46f1-bcaf-84dd46ae06dc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:33.832094 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ec7ee060-1541-46f1-bcaf-84dd46ae06dc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:33.832534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ec7ee060-1541-46f1-bcaf-84dd46ae06dc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:33.978036 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ec7ee060-1541-46f1-bcaf-84dd46ae06dc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:33.985969 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ec7ee060-1541-46f1-bcaf-84dd46ae06dc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.165986 Aug 01 14:21:33.986550 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 87/168] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:33 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:34.130044 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6dfd01a8-9179-4735-9ed7-ceeed5ed6cad tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:34.130044 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-6dfd01a8-9179-4735-9ed7-ceeed5ed6cad tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:34.134994 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6dfd01a8-9179-4735-9ed7-ceeed5ed6cad tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:34.135443 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6dfd01a8-9179-4735-9ed7-ceeed5ed6cad tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:34.136211 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6dfd01a8-9179-4735-9ed7-ceeed5ed6cad tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:34.136773 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6dfd01a8-9179-4735-9ed7-ceeed5ed6cad tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:34.155772 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=100 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:34.278781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6dfd01a8-9179-4735-9ed7-ceeed5ed6cad tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:34.287513 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-6dfd01a8-9179-4735-9ed7-ceeed5ed6cad tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.163547 Aug 01 14:21:34.288101 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 82/169] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:34 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:35.011053 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-427bd886-e3ab-48da-9a1a-4f524d0fbc62 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:35.011780 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-427bd886-e3ab-48da-9a1a-4f524d0fbc62 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:35.018530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-427bd886-e3ab-48da-9a1a-4f524d0fbc62 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:35.019059 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-427bd886-e3ab-48da-9a1a-4f524d0fbc62 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:35.020160 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-427bd886-e3ab-48da-9a1a-4f524d0fbc62 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:35.020668 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-427bd886-e3ab-48da-9a1a-4f524d0fbc62 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:35.309409 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-61e8d5b0-3c09-4db6-9bf6-3cafff7248b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:35.310048 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-61e8d5b0-3c09-4db6-9bf6-3cafff7248b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:35.316523 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-61e8d5b0-3c09-4db6-9bf6-3cafff7248b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:35.318521 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-61e8d5b0-3c09-4db6-9bf6-3cafff7248b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:35.319587 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-61e8d5b0-3c09-4db6-9bf6-3cafff7248b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:35.321322 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-61e8d5b0-3c09-4db6-9bf6-3cafff7248b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:35.359057 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-427bd886-e3ab-48da-9a1a-4f524d0fbc62 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:35.369602 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-427bd886-e3ab-48da-9a1a-4f524d0fbc62 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1362 microversion: 2.1 time: 0.362152 Aug 01 14:21:35.371034 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 88/170] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:35 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:35.518481 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-61e8d5b0-3c09-4db6-9bf6-3cafff7248b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:35.529325 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-61e8d5b0-3c09-4db6-9bf6-3cafff7248b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.223762 Aug 01 14:21:35.529771 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 83/171] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:35 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:36.400083 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5c64eee0-5d42-42e7-b2c2-aed2f5fa2652 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:36.401204 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5c64eee0-5d42-42e7-b2c2-aed2f5fa2652 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:36.414208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5c64eee0-5d42-42e7-b2c2-aed2f5fa2652 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:36.415063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5c64eee0-5d42-42e7-b2c2-aed2f5fa2652 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:36.416024 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5c64eee0-5d42-42e7-b2c2-aed2f5fa2652 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:36.416841 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5c64eee0-5d42-42e7-b2c2-aed2f5fa2652 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:36.551881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-de87308b-9635-47b2-91f2-cfe468e59bf5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:36.553165 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-de87308b-9635-47b2-91f2-cfe468e59bf5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:36.559968 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-de87308b-9635-47b2-91f2-cfe468e59bf5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:36.560559 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-de87308b-9635-47b2-91f2-cfe468e59bf5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:36.561451 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-de87308b-9635-47b2-91f2-cfe468e59bf5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:36.562013 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-de87308b-9635-47b2-91f2-cfe468e59bf5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:36.571676 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-5c64eee0-5d42-42e7-b2c2-aed2f5fa2652 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:36.580786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5c64eee0-5d42-42e7-b2c2-aed2f5fa2652 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1548 microversion: 2.1 time: 0.191573 Aug 01 14:21:36.581652 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 89/172] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:36 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1548 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:36.604906 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d7afed4f-b68a-4271-bdad-d067defbb8ec tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:36.606421 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d7afed4f-b68a-4271-bdad-d067defbb8ec tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:36.613518 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d7afed4f-b68a-4271-bdad-d067defbb8ec tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:36.614264 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d7afed4f-b68a-4271-bdad-d067defbb8ec tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:36.615872 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d7afed4f-b68a-4271-bdad-d067defbb8ec tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:36.616715 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d7afed4f-b68a-4271-bdad-d067defbb8ec tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:36.622042 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:36.749541 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d7afed4f-b68a-4271-bdad-d067defbb8ec tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150517 Aug 01 14:21:36.759427 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 90/173] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Aug 1 14:21:36 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:36.857192 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-de87308b-9635-47b2-91f2-cfe468e59bf5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:36.866323 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-de87308b-9635-47b2-91f2-cfe468e59bf5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.317706 Aug 01 14:21:36.866693 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 84/174] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:36 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:37.895242 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-9642e915-5e4a-45cf-bcef-ef690a60a3f7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:37.896202 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-9642e915-5e4a-45cf-bcef-ef690a60a3f7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:37.904768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9642e915-5e4a-45cf-bcef-ef690a60a3f7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:37.905285 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9642e915-5e4a-45cf-bcef-ef690a60a3f7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:37.906409 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9642e915-5e4a-45cf-bcef-ef690a60a3f7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:37.907045 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9642e915-5e4a-45cf-bcef-ef690a60a3f7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:38.321214 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-9642e915-5e4a-45cf-bcef-ef690a60a3f7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:38.336747 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-9642e915-5e4a-45cf-bcef-ef690a60a3f7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.446527 Aug 01 14:21:38.339152 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 91/175] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:37 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:38.370296 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-ae74aae2-a44e-43c6-9fc0-679a4b79b138 req-86e51992-8111-491f-a3ac-f26fb05a4759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb5f425-d747-41d4-bed5-211a5d80e32b", "tag": "5314437c-b6c2-401f-b4c2-178a92e38017"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:38.379916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-ae74aae2-a44e-43c6-9fc0-679a4b79b138 req-86e51992-8111-491f-a3ac-f26fb05a4759 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:38.380357 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-ae74aae2-a44e-43c6-9fc0-679a4b79b138 req-86e51992-8111-491f-a3ac-f26fb05a4759 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:38.392265 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-ae74aae2-a44e-43c6-9fc0-679a4b79b138 req-86e51992-8111-491f-a3ac-f26fb05a4759 service nova] Creating event network-changed:5314437c-b6c2-401f-b4c2-178a92e38017 for instance 2eb5f425-d747-41d4-bed5-211a5d80e32b on hv-cinder-78729 Aug 01 14:21:38.398890 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-ae74aae2-a44e-43c6-9fc0-679a4b79b138 req-86e51992-8111-491f-a3ac-f26fb05a4759 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032352 Aug 01 14:21:38.399514 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 85/176] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:39.360488 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5326094d-5908-4a63-abd2-3dbde7535cde tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:39.361206 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5326094d-5908-4a63-abd2-3dbde7535cde tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:39.370129 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5326094d-5908-4a63-abd2-3dbde7535cde tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:39.370688 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5326094d-5908-4a63-abd2-3dbde7535cde tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:39.372547 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5326094d-5908-4a63-abd2-3dbde7535cde tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:39.372547 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5326094d-5908-4a63-abd2-3dbde7535cde tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:39.531293 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-5326094d-5908-4a63-abd2-3dbde7535cde tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:39.539686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5326094d-5908-4a63-abd2-3dbde7535cde tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.183305 Aug 01 14:21:39.540288 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 92/177] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:39 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:40.562494 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-2c2e70d5-37e5-4734-9090-9a5624498ff6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:40.563195 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-2c2e70d5-37e5-4734-9090-9a5624498ff6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:40.569691 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2c2e70d5-37e5-4734-9090-9a5624498ff6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:40.570169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2c2e70d5-37e5-4734-9090-9a5624498ff6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:40.570978 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2c2e70d5-37e5-4734-9090-9a5624498ff6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:40.571414 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2c2e70d5-37e5-4734-9090-9a5624498ff6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:40.703916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2c2e70d5-37e5-4734-9090-9a5624498ff6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:40.712135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-2c2e70d5-37e5-4734-9090-9a5624498ff6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.154190 Aug 01 14:21:40.712708 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 86/178] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:40 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:41.733501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-135ec278-0d55-46dc-bc7a-a297864ffc6f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:41.734069 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-135ec278-0d55-46dc-bc7a-a297864ffc6f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:41.741328 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-135ec278-0d55-46dc-bc7a-a297864ffc6f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:41.741849 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-135ec278-0d55-46dc-bc7a-a297864ffc6f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:41.742713 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-135ec278-0d55-46dc-bc7a-a297864ffc6f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:41.743148 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-135ec278-0d55-46dc-bc7a-a297864ffc6f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:41.879834 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-135ec278-0d55-46dc-bc7a-a297864ffc6f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:41.887446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-135ec278-0d55-46dc-bc7a-a297864ffc6f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.157802 Aug 01 14:21:41.901992 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 93/179] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:41 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:42.908092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-198befe9-fbe1-4aa2-8d2f-d0ea8b2d5138 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:42.908680 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-198befe9-fbe1-4aa2-8d2f-d0ea8b2d5138 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:42.915726 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-198befe9-fbe1-4aa2-8d2f-d0ea8b2d5138 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:42.916184 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-198befe9-fbe1-4aa2-8d2f-d0ea8b2d5138 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:42.916970 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-198befe9-fbe1-4aa2-8d2f-d0ea8b2d5138 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:42.917415 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-198befe9-fbe1-4aa2-8d2f-d0ea8b2d5138 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:43.115291 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-198befe9-fbe1-4aa2-8d2f-d0ea8b2d5138 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:43.125732 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-198befe9-fbe1-4aa2-8d2f-d0ea8b2d5138 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.221440 Aug 01 14:21:43.126914 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 87/180] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:42 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:44.148572 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5c6eb321-254e-429b-bb91-bc891cb1f966 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:44.149198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5c6eb321-254e-429b-bb91-bc891cb1f966 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:44.156184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5c6eb321-254e-429b-bb91-bc891cb1f966 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:44.156633 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5c6eb321-254e-429b-bb91-bc891cb1f966 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:44.157591 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5c6eb321-254e-429b-bb91-bc891cb1f966 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:44.158051 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5c6eb321-254e-429b-bb91-bc891cb1f966 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:44.343875 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-5c6eb321-254e-429b-bb91-bc891cb1f966 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:44.351733 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5c6eb321-254e-429b-bb91-bc891cb1f966 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.207450 Aug 01 14:21:44.352608 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 94/181] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:44 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:45.373007 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-61638424-553d-4006-a1f0-e1a0d6312400 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:45.373607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-61638424-553d-4006-a1f0-e1a0d6312400 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:45.379849 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-61638424-553d-4006-a1f0-e1a0d6312400 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:45.380303 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-61638424-553d-4006-a1f0-e1a0d6312400 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:45.381944 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-61638424-553d-4006-a1f0-e1a0d6312400 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:45.385275 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-61638424-553d-4006-a1f0-e1a0d6312400 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:45.562878 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-61638424-553d-4006-a1f0-e1a0d6312400 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:45.571650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-61638424-553d-4006-a1f0-e1a0d6312400 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.202950 Aug 01 14:21:45.573906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 88/182] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:45 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:46.594574 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-dcd7efee-3579-4652-a4af-470a511da892 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:46.595312 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-dcd7efee-3579-4652-a4af-470a511da892 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:46.602758 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dcd7efee-3579-4652-a4af-470a511da892 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:46.603313 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dcd7efee-3579-4652-a4af-470a511da892 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:46.604177 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dcd7efee-3579-4652-a4af-470a511da892 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:46.604627 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dcd7efee-3579-4652-a4af-470a511da892 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:46.755373 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-dcd7efee-3579-4652-a4af-470a511da892 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:46.769990 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-dcd7efee-3579-4652-a4af-470a511da892 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.179137 Aug 01 14:21:46.770491 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 95/183] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:46 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:47.792483 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3a33fe98-db28-4301-9ae5-2f385f271ddc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:47.794404 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3a33fe98-db28-4301-9ae5-2f385f271ddc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:47.804019 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3a33fe98-db28-4301-9ae5-2f385f271ddc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:47.805262 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3a33fe98-db28-4301-9ae5-2f385f271ddc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:47.807033 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3a33fe98-db28-4301-9ae5-2f385f271ddc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:47.807664 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3a33fe98-db28-4301-9ae5-2f385f271ddc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:47.970932 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3a33fe98-db28-4301-9ae5-2f385f271ddc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:47.981367 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3a33fe98-db28-4301-9ae5-2f385f271ddc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.193259 Aug 01 14:21:47.982172 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 89/184] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:47 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:49.002531 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-51dafc8f-fbf2-4419-aa6e-6c9583f11974 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:49.003134 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-51dafc8f-fbf2-4419-aa6e-6c9583f11974 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:49.014599 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-51dafc8f-fbf2-4419-aa6e-6c9583f11974 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:49.014599 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-51dafc8f-fbf2-4419-aa6e-6c9583f11974 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:49.014797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-51dafc8f-fbf2-4419-aa6e-6c9583f11974 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:49.015120 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-51dafc8f-fbf2-4419-aa6e-6c9583f11974 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:49.177028 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-51dafc8f-fbf2-4419-aa6e-6c9583f11974 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:49.185319 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-51dafc8f-fbf2-4419-aa6e-6c9583f11974 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.186626 Aug 01 14:21:49.185966 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 96/185] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:48 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:49.856796 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a3b748e8-49db-4ba9-887b-9d043906cd7f tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:49.858359 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a3b748e8-49db-4ba9-887b-9d043906cd7f tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:49.867029 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3b748e8-49db-4ba9-887b-9d043906cd7f tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:49.867752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3b748e8-49db-4ba9-887b-9d043906cd7f tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:49.868701 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3b748e8-49db-4ba9-887b-9d043906cd7f tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:49.869742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3b748e8-49db-4ba9-887b-9d043906cd7f tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:49.905177 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a3b748e8-49db-4ba9-887b-9d043906cd7f tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Going to try to terminate instance {{(pid=118247) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:21:50.207371 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5370bd96-3854-44f4-a026-f98d747dfafc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:50.207892 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5370bd96-3854-44f4-a026-f98d747dfafc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:50.216556 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5370bd96-3854-44f4-a026-f98d747dfafc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:50.218278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5370bd96-3854-44f4-a026-f98d747dfafc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:50.219084 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5370bd96-3854-44f4-a026-f98d747dfafc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:50.220921 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5370bd96-3854-44f4-a026-f98d747dfafc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:50.310341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a3b748e8-49db-4ba9-887b-9d043906cd7f tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "DELETE /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 204 len: 0 microversion: 2.1 time: 0.460607 Aug 01 14:21:50.310940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 90/186] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:21:49 2022] DELETE /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:21:50.321313 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-adf74ccd-78a5-4df2-88de-d8ba873102cc tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:50.322159 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-adf74ccd-78a5-4df2-88de-d8ba873102cc tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:50.328538 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-adf74ccd-78a5-4df2-88de-d8ba873102cc tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:50.328977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-adf74ccd-78a5-4df2-88de-d8ba873102cc tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:50.329781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-adf74ccd-78a5-4df2-88de-d8ba873102cc tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:50.330249 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-adf74ccd-78a5-4df2-88de-d8ba873102cc tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:50.378312 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-5370bd96-3854-44f4-a026-f98d747dfafc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:50.388993 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5370bd96-3854-44f4-a026-f98d747dfafc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.185337 Aug 01 14:21:50.389958 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 97/187] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:50 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:50.520659 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-adf74ccd-78a5-4df2-88de-d8ba873102cc tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:50.526746 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-adf74ccd-78a5-4df2-88de-d8ba873102cc tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1555 microversion: 2.1 time: 0.210906 Aug 01 14:21:50.527324 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 91/188] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:50 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1555 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:51.410706 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-60a909e1-7140-4aff-9d78-81337986eea9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:51.411320 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-60a909e1-7140-4aff-9d78-81337986eea9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:51.419060 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-60a909e1-7140-4aff-9d78-81337986eea9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:51.419786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-60a909e1-7140-4aff-9d78-81337986eea9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:51.420848 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-60a909e1-7140-4aff-9d78-81337986eea9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:51.421290 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-60a909e1-7140-4aff-9d78-81337986eea9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:51.548960 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-cfefcc94-6c8d-4716-b16d-ef51aa36c23d tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:51.549617 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-cfefcc94-6c8d-4716-b16d-ef51aa36c23d tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:51.557676 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cfefcc94-6c8d-4716-b16d-ef51aa36c23d tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:51.558173 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cfefcc94-6c8d-4716-b16d-ef51aa36c23d tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:51.559069 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cfefcc94-6c8d-4716-b16d-ef51aa36c23d tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:51.559989 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cfefcc94-6c8d-4716-b16d-ef51aa36c23d tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:51.587658 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-60a909e1-7140-4aff-9d78-81337986eea9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:51.595840 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-60a909e1-7140-4aff-9d78-81337986eea9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.188684 Aug 01 14:21:51.596442 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 98/189] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:51 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:51.701066 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-cfefcc94-6c8d-4716-b16d-ef51aa36c23d tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:51.710295 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-cfefcc94-6c8d-4716-b16d-ef51aa36c23d tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1555 microversion: 2.1 time: 0.165253 Aug 01 14:21:51.711203 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 92/190] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:51 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:52.622821 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e717e596-1bcb-4799-b1f5-34e60fb72008 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:52.622821 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e717e596-1bcb-4799-b1f5-34e60fb72008 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:52.632732 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e717e596-1bcb-4799-b1f5-34e60fb72008 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:52.633821 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e717e596-1bcb-4799-b1f5-34e60fb72008 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:52.635898 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e717e596-1bcb-4799-b1f5-34e60fb72008 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:52.636809 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e717e596-1bcb-4799-b1f5-34e60fb72008 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:52.731696 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-71a903c2-09b9-42f8-8a53-a666d3be591d tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:52.732312 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-71a903c2-09b9-42f8-8a53-a666d3be591d tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:52.738656 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-71a903c2-09b9-42f8-8a53-a666d3be591d tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:52.739410 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-71a903c2-09b9-42f8-8a53-a666d3be591d tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:52.740189 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-71a903c2-09b9-42f8-8a53-a666d3be591d tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:52.740626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-71a903c2-09b9-42f8-8a53-a666d3be591d tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:52.786752 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e717e596-1bcb-4799-b1f5-34e60fb72008 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:52.795037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e717e596-1bcb-4799-b1f5-34e60fb72008 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.181200 Aug 01 14:21:52.796184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 99/191] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:52 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:52.904439 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-71a903c2-09b9-42f8-8a53-a666d3be591d tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:52.913976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-71a903c2-09b9-42f8-8a53-a666d3be591d tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1555 microversion: 2.1 time: 0.185149 Aug 01 14:21:52.914728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 93/192] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:52 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1555 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:53.818724 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1f837981-18b6-4939-b181-112b46b7f242 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:53.820310 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-1f837981-18b6-4939-b181-112b46b7f242 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:53.827233 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1f837981-18b6-4939-b181-112b46b7f242 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:53.827700 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1f837981-18b6-4939-b181-112b46b7f242 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:53.828506 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1f837981-18b6-4939-b181-112b46b7f242 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:53.829133 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1f837981-18b6-4939-b181-112b46b7f242 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:53.935677 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-edbf0a44-6b7c-4541-a57a-f244f1626320 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:53.936407 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-edbf0a44-6b7c-4541-a57a-f244f1626320 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:53.948441 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-edbf0a44-6b7c-4541-a57a-f244f1626320 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:53.948441 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-edbf0a44-6b7c-4541-a57a-f244f1626320 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:53.948441 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-edbf0a44-6b7c-4541-a57a-f244f1626320 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:53.948441 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-edbf0a44-6b7c-4541-a57a-f244f1626320 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:53.973794 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-1f837981-18b6-4939-b181-112b46b7f242 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:53.983236 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-1f837981-18b6-4939-b181-112b46b7f242 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.169629 Aug 01 14:21:53.998570 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 100/193] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:53 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:54.098130 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-edbf0a44-6b7c-4541-a57a-f244f1626320 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:54.106839 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-edbf0a44-6b7c-4541-a57a-f244f1626320 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1555 microversion: 2.1 time: 0.174932 Aug 01 14:21:54.107419 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 94/194] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:53 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:55.007397 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-771b96cd-f340-4241-b698-53f09a789f93 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:55.008193 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-771b96cd-f340-4241-b698-53f09a789f93 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:55.014873 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-771b96cd-f340-4241-b698-53f09a789f93 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:55.015328 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-771b96cd-f340-4241-b698-53f09a789f93 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:55.016108 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-771b96cd-f340-4241-b698-53f09a789f93 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:55.016550 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-771b96cd-f340-4241-b698-53f09a789f93 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:55.129287 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c8558d48-69e3-4b7d-b6c0-4c7e9f23671c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:55.130052 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c8558d48-69e3-4b7d-b6c0-4c7e9f23671c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:55.136650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c8558d48-69e3-4b7d-b6c0-4c7e9f23671c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:55.137210 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c8558d48-69e3-4b7d-b6c0-4c7e9f23671c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:55.138124 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c8558d48-69e3-4b7d-b6c0-4c7e9f23671c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:55.138678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c8558d48-69e3-4b7d-b6c0-4c7e9f23671c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:55.155828 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-771b96cd-f340-4241-b698-53f09a789f93 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:55.165215 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-771b96cd-f340-4241-b698-53f09a789f93 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.162353 Aug 01 14:21:55.166138 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 101/195] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:55 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:55.293870 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c8558d48-69e3-4b7d-b6c0-4c7e9f23671c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:55.302781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c8558d48-69e3-4b7d-b6c0-4c7e9f23671c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1555 microversion: 2.1 time: 0.177327 Aug 01 14:21:55.304240 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 95/196] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:55 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:56.187894 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-a0e3c8c8-664a-4a8b-a648-eb3e87e6bb7f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:56.189010 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-a0e3c8c8-664a-4a8b-a648-eb3e87e6bb7f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:56.198293 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a0e3c8c8-664a-4a8b-a648-eb3e87e6bb7f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:56.198927 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a0e3c8c8-664a-4a8b-a648-eb3e87e6bb7f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:56.200000 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a0e3c8c8-664a-4a8b-a648-eb3e87e6bb7f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:56.200528 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a0e3c8c8-664a-4a8b-a648-eb3e87e6bb7f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:56.325569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-571ffc5f-e722-4e3d-a617-16e9515ae255 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:56.326208 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-571ffc5f-e722-4e3d-a617-16e9515ae255 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:56.332642 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-571ffc5f-e722-4e3d-a617-16e9515ae255 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:56.333126 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-571ffc5f-e722-4e3d-a617-16e9515ae255 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:56.334269 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-571ffc5f-e722-4e3d-a617-16e9515ae255 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:56.335327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-571ffc5f-e722-4e3d-a617-16e9515ae255 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:56.340266 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a0e3c8c8-664a-4a8b-a648-eb3e87e6bb7f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:56.348340 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-a0e3c8c8-664a-4a8b-a648-eb3e87e6bb7f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.164397 Aug 01 14:21:56.362753 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 102/197] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:56 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:56.517405 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-571ffc5f-e722-4e3d-a617-16e9515ae255 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:56.526493 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-571ffc5f-e722-4e3d-a617-16e9515ae255 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1555 microversion: 2.1 time: 0.204760 Aug 01 14:21:56.527091 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 96/198] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:56 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1555 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:56.754066 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-ac9ce7c1-3507-4781-97e1-e354b2b152c1 req-2bf9592a-7aa9-4bd3-b6a3-4ea9c970a5fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e", "name": "network-vif-deleted", "tag": "38972512-acb0-4637-b22c-a3933134341b"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:56.765606 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-ac9ce7c1-3507-4781-97e1-e354b2b152c1 req-2bf9592a-7aa9-4bd3-b6a3-4ea9c970a5fb service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:56.766530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-ac9ce7c1-3507-4781-97e1-e354b2b152c1 req-2bf9592a-7aa9-4bd3-b6a3-4ea9c970a5fb service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:56.787429 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-ac9ce7c1-3507-4781-97e1-e354b2b152c1 req-2bf9592a-7aa9-4bd3-b6a3-4ea9c970a5fb service nova] Creating event network-vif-deleted:38972512-acb0-4637-b22c-a3933134341b for instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e on hv-cinder-78729 Aug 01 14:21:56.793059 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-ac9ce7c1-3507-4781-97e1-e354b2b152c1 req-2bf9592a-7aa9-4bd3-b6a3-4ea9c970a5fb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042904 Aug 01 14:21:56.794852 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 103/199] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:57.385108 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e8158c35-b093-439d-9119-8f918d7b858a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:57.385740 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e8158c35-b093-439d-9119-8f918d7b858a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:57.391719 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e8158c35-b093-439d-9119-8f918d7b858a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:57.392167 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e8158c35-b093-439d-9119-8f918d7b858a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:57.392926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e8158c35-b093-439d-9119-8f918d7b858a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:57.393363 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e8158c35-b093-439d-9119-8f918d7b858a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:57.527428 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e8158c35-b093-439d-9119-8f918d7b858a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:57.535065 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e8158c35-b093-439d-9119-8f918d7b858a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.154281 Aug 01 14:21:57.535629 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 97/200] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:57 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:57.549032 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f442089d-8507-4110-8149-332ac112d1ca tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:57.549660 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f442089d-8507-4110-8149-332ac112d1ca tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:57.555882 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f442089d-8507-4110-8149-332ac112d1ca tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:57.556330 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f442089d-8507-4110-8149-332ac112d1ca tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:57.557098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f442089d-8507-4110-8149-332ac112d1ca tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:57.557540 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f442089d-8507-4110-8149-332ac112d1ca tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:57.640083 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f442089d-8507-4110-8149-332ac112d1ca tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:57.648909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f442089d-8507-4110-8149-332ac112d1ca tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1513 microversion: 2.1 time: 0.104566 Aug 01 14:21:57.649495 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 104/201] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:57 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1513 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:58.556587 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e0953f67-a9ed-4999-8577-7677e4258a2a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:58.557353 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e0953f67-a9ed-4999-8577-7677e4258a2a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:58.563460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e0953f67-a9ed-4999-8577-7677e4258a2a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:58.563910 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e0953f67-a9ed-4999-8577-7677e4258a2a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:58.564670 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e0953f67-a9ed-4999-8577-7677e4258a2a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:58.565109 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e0953f67-a9ed-4999-8577-7677e4258a2a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:58.569788 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:58.669866 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3cb21e43-b11d-4b65-8330-edd0893ebd46 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:58.670605 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3cb21e43-b11d-4b65-8330-edd0893ebd46 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:58.676619 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3cb21e43-b11d-4b65-8330-edd0893ebd46 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:58.677066 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3cb21e43-b11d-4b65-8330-edd0893ebd46 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:58.677844 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3cb21e43-b11d-4b65-8330-edd0893ebd46 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:58.679639 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3cb21e43-b11d-4b65-8330-edd0893ebd46 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:58.698024 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e0953f67-a9ed-4999-8577-7677e4258a2a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:58.705375 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e0953f67-a9ed-4999-8577-7677e4258a2a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.152929 Aug 01 14:21:58.705981 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 98/202] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:58 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:58.739603 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3cb21e43-b11d-4b65-8330-edd0893ebd46 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:58.748672 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3cb21e43-b11d-4b65-8330-edd0893ebd46 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1513 microversion: 2.1 time: 0.082855 Aug 01 14:21:58.749240 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 105/203] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:58 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1513 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:59.735578 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-789644b3-2e48-4723-8534-08c3090c6457 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:59.736310 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-789644b3-2e48-4723-8534-08c3090c6457 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:59.738470 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:59.744732 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-789644b3-2e48-4723-8534-08c3090c6457 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:59.745180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-789644b3-2e48-4723-8534-08c3090c6457 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:59.745984 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-789644b3-2e48-4723-8534-08c3090c6457 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:59.746442 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-789644b3-2e48-4723-8534-08c3090c6457 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:59.771287 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-395b36f7-d36b-4425-b564-87b68e4755c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:59.772008 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-395b36f7-d36b-4425-b564-87b68e4755c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:59.779773 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-395b36f7-d36b-4425-b564-87b68e4755c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:59.780333 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-395b36f7-d36b-4425-b564-87b68e4755c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:59.781341 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-395b36f7-d36b-4425-b564-87b68e4755c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:59.782025 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-395b36f7-d36b-4425-b564-87b68e4755c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:59.860531 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-395b36f7-d36b-4425-b564-87b68e4755c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:59.869503 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-395b36f7-d36b-4425-b564-87b68e4755c8 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1346 microversion: 2.1 time: 0.101942 Aug 01 14:21:59.873901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 106/204] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:59 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:59.900865 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-789644b3-2e48-4723-8534-08c3090c6457 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:59.908071 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-789644b3-2e48-4723-8534-08c3090c6457 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.176319 Aug 01 14:21:59.908744 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 99/205] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:59 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:00.891503 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-69f6e635-aeda-47ba-8857-0293df889a32 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:00.892105 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-69f6e635-aeda-47ba-8857-0293df889a32 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:00.900348 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-69f6e635-aeda-47ba-8857-0293df889a32 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:00.901024 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-69f6e635-aeda-47ba-8857-0293df889a32 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:00.901824 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-69f6e635-aeda-47ba-8857-0293df889a32 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:00.902265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-69f6e635-aeda-47ba-8857-0293df889a32 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:00.929444 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0c05e676-f11d-4153-a156-08aa39ae21b9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:00.930412 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0c05e676-f11d-4153-a156-08aa39ae21b9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:00.938232 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0c05e676-f11d-4153-a156-08aa39ae21b9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:00.938626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0c05e676-f11d-4153-a156-08aa39ae21b9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:00.940168 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0c05e676-f11d-4153-a156-08aa39ae21b9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:00.940642 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0c05e676-f11d-4153-a156-08aa39ae21b9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:00.940808 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-69f6e635-aeda-47ba-8857-0293df889a32 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:00.941252 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-69f6e635-aeda-47ba-8857-0293df889a32 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:00.941696 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-69f6e635-aeda-47ba-8857-0293df889a32 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lazy-loading 'fault' on Instance uuid aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:22:00.948347 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=100 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:00.993524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-69f6e635-aeda-47ba-8857-0293df889a32 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea98d747777d42a5a9192dd2c4746038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:01.004083 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-69f6e635-aeda-47ba-8857-0293df889a32 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 200 len: 1351 microversion: 2.1 time: 0.116603 Aug 01 14:22:01.005883 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 107/206] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:00 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 1351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:01.093842 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0c05e676-f11d-4153-a156-08aa39ae21b9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:01.102441 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0c05e676-f11d-4153-a156-08aa39ae21b9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.177452 Aug 01 14:22:01.103013 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 100/207] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:00 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:02.025576 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-621077cc-dcb3-4c64-8f09-868d0301812e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:02.026647 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-621077cc-dcb3-4c64-8f09-868d0301812e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:02.034226 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-621077cc-dcb3-4c64-8f09-868d0301812e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:02.034673 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-621077cc-dcb3-4c64-8f09-868d0301812e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:02.037364 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-621077cc-dcb3-4c64-8f09-868d0301812e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:02.037857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-621077cc-dcb3-4c64-8f09-868d0301812e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:02.052626 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-621077cc-dcb3-4c64-8f09-868d0301812e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] HTTP exception thrown: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-621077cc-dcb3-4c64-8f09-868d0301812e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Request method failure captured: Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e HTTP/1.1 Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-E1P0RIhrn6-lE1oP12auaWfwV3ylDxjKvCQR8jyRO4eE2fWhsHF5Uk_92BPs1FehHAe_xHNatfJvLhB5wDYYUKJPcajqllRU1GTcCoCNCSSTwVPhMgOWlcDZDrmqgdSUuS2tcLIKEnvz9Bgc5EXy9bt1P7IsbqaVOya756nWGCRtc Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: f351a73d1a584b2e9f51c4a86dfff0e3 Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-DeleteServersTestJSON-155994710 Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:22:02.058385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:22:02.059914 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f351a73d1a584b2e9f51c4a86dfff0e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f351a73d1a584b2e9f51c4a86dfff0e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f351a73d1a584b2e9f51c4a86dfff0e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f351a73d1a584b2e9f51c4a86dfff0e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:22:02.059914 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-DeleteServersTestJSON-155994710 Aug 01 14:22:02.059914 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: f351a73d1a584b2e9f51c4a86dfff0e3 Aug 01 14:22:02.059914 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-DeleteServersTestJSON-155994710 Aug 01 14:22:02.059914 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-DeleteServersTestJSON-155994710-project Aug 01 14:22:02.059914 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:22:02.059914 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:22:02.059914 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: ea98d747777d42a5a9192dd2c4746038 Aug 01 14:22:02.059914 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-DeleteServersTestJSON-155994710-project Aug 01 14:22:02.059914 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:22:02.059914 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:02.059914 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': 'aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e'} Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:22:02.060804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:02.062222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:02.063471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-621077cc-dcb3-4c64-8f09-868d0301812e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Returning 404 to user: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:22:02.063471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-621077cc-dcb3-4c64-8f09-868d0301812e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 404 len: 111 microversion: 2.1 time: 0.039590 Aug 01 14:22:02.063471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 108/208] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:02 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:22:02.129947 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-502df217-8266-4a17-a2cd-0e63fa4c6e9e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:02.129947 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-502df217-8266-4a17-a2cd-0e63fa4c6e9e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:02.134597 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-502df217-8266-4a17-a2cd-0e63fa4c6e9e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:02.135334 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-502df217-8266-4a17-a2cd-0e63fa4c6e9e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:02.136281 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-502df217-8266-4a17-a2cd-0e63fa4c6e9e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:02.136931 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-502df217-8266-4a17-a2cd-0e63fa4c6e9e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:02.194182 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-48e54d2d-6d3e-4a87-a674-c945952bed6e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:02.196919 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-48e54d2d-6d3e-4a87-a674-c945952bed6e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:02.206657 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-48e54d2d-6d3e-4a87-a674-c945952bed6e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:02.211079 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-48e54d2d-6d3e-4a87-a674-c945952bed6e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:02.213902 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-48e54d2d-6d3e-4a87-a674-c945952bed6e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:02.214705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-48e54d2d-6d3e-4a87-a674-c945952bed6e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:02.235900 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-48e54d2d-6d3e-4a87-a674-c945952bed6e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] HTTP exception thrown: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-48e54d2d-6d3e-4a87-a674-c945952bed6e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Request method failure captured: Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e/os-volume_attachments HTTP/1.1 Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-E1P0RIhrn6-lE1oP12auaWfwV3ylDxjKvCQR8jyRO4eE2fWhsHF5Uk_92BPs1FehHAe_xHNatfJvLhB5wDYYUKJPcajqllRU1GTcCoCNCSSTwVPhMgOWlcDZDrmqgdSUuS2tcLIKEnvz9Bgc5EXy9bt1P7IsbqaVOya756nWGCRtc Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: f351a73d1a584b2e9f51c4a86dfff0e3 Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-DeleteServersTestJSON-155994710 Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:22:02.245292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:22:02.246788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f351a73d1a584b2e9f51c4a86dfff0e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f351a73d1a584b2e9f51c4a86dfff0e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f351a73d1a584b2e9f51c4a86dfff0e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f351a73d1a584b2e9f51c4a86dfff0e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:22:02.246788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-DeleteServersTestJSON-155994710 Aug 01 14:22:02.246788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: f351a73d1a584b2e9f51c4a86dfff0e3 Aug 01 14:22:02.246788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-DeleteServersTestJSON-155994710 Aug 01 14:22:02.246788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-DeleteServersTestJSON-155994710-project Aug 01 14:22:02.246788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:22:02.246788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:22:02.246788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: ea98d747777d42a5a9192dd2c4746038 Aug 01 14:22:02.246788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-DeleteServersTestJSON-155994710-project Aug 01 14:22:02.246788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:22:02.246788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:02.246788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'server_id': 'aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e'} Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:22:02.247579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:02.248901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:02.253408 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-48e54d2d-6d3e-4a87-a674-c945952bed6e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Returning 404 to user: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:22:02.253408 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-48e54d2d-6d3e-4a87-a674-c945952bed6e tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.057587 Aug 01 14:22:02.253408 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 109/209] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:22:02 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e/os-volume_attachments => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:22:02.324492 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-502df217-8266-4a17-a2cd-0e63fa4c6e9e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:02.336090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-502df217-8266-4a17-a2cd-0e63fa4c6e9e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.211770 Aug 01 14:22:02.336090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 101/210] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:02 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:03.355694 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0903c4cb-9fcf-4548-a52c-e8a6fff25058 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:03.356346 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0903c4cb-9fcf-4548-a52c-e8a6fff25058 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:03.358714 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=50 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:03.363478 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0903c4cb-9fcf-4548-a52c-e8a6fff25058 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:03.363959 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0903c4cb-9fcf-4548-a52c-e8a6fff25058 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:03.364708 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0903c4cb-9fcf-4548-a52c-e8a6fff25058 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:03.365435 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0903c4cb-9fcf-4548-a52c-e8a6fff25058 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:03.511949 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-0903c4cb-9fcf-4548-a52c-e8a6fff25058 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:03.519955 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0903c4cb-9fcf-4548-a52c-e8a6fff25058 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.168291 Aug 01 14:22:03.520578 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 110/211] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:03 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:04.541094 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4675b0a5-9106-47a2-a280-d0a8afd70a88 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:04.541860 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-4675b0a5-9106-47a2-a280-d0a8afd70a88 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:04.547915 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4675b0a5-9106-47a2-a280-d0a8afd70a88 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:04.548354 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4675b0a5-9106-47a2-a280-d0a8afd70a88 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:04.549107 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4675b0a5-9106-47a2-a280-d0a8afd70a88 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:04.549540 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4675b0a5-9106-47a2-a280-d0a8afd70a88 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:04.692918 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4675b0a5-9106-47a2-a280-d0a8afd70a88 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:04.701880 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4675b0a5-9106-47a2-a280-d0a8afd70a88 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.164929 Aug 01 14:22:04.707112 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 102/212] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:04 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:05.723547 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7e72cace-188f-493d-8803-c1ecaf48438c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:05.724228 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7e72cace-188f-493d-8803-c1ecaf48438c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:05.731608 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7e72cace-188f-493d-8803-c1ecaf48438c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:05.732066 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7e72cace-188f-493d-8803-c1ecaf48438c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:05.732842 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7e72cace-188f-493d-8803-c1ecaf48438c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:05.733283 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7e72cace-188f-493d-8803-c1ecaf48438c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:05.958271 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7e72cace-188f-493d-8803-c1ecaf48438c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:05.967651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7e72cace-188f-493d-8803-c1ecaf48438c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.247822 Aug 01 14:22:05.968408 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 111/213] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:05 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:06.989048 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-cb31611e-5580-4c64-9c11-5a96ad679a96 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:06.993357 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-cb31611e-5580-4c64-9c11-5a96ad679a96 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:06.996043 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cb31611e-5580-4c64-9c11-5a96ad679a96 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:06.996494 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cb31611e-5580-4c64-9c11-5a96ad679a96 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:06.997255 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cb31611e-5580-4c64-9c11-5a96ad679a96 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:06.997694 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cb31611e-5580-4c64-9c11-5a96ad679a96 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:07.138326 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-cb31611e-5580-4c64-9c11-5a96ad679a96 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:07.138442 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-cbb43d15-351e-48bf-8ba3-f1023e8a1296 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:07.138442 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-cbb43d15-351e-48bf-8ba3-f1023e8a1296 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:07.142549 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cbb43d15-351e-48bf-8ba3-f1023e8a1296 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:07.143112 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cbb43d15-351e-48bf-8ba3-f1023e8a1296 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:07.143718 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-cb31611e-5580-4c64-9c11-5a96ad679a96 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.158322 Aug 01 14:22:07.143831 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cbb43d15-351e-48bf-8ba3-f1023e8a1296 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:07.144367 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cbb43d15-351e-48bf-8ba3-f1023e8a1296 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:07.153622 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 103/214] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:06 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:07.166899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-cbb43d15-351e-48bf-8ba3-f1023e8a1296 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] HTTP exception thrown: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-cbb43d15-351e-48bf-8ba3-f1023e8a1296 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Request method failure captured: Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: DELETE /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e HTTP/1.1 Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-E1P0RIhrn6-lE1oP12auaWfwV3ylDxjKvCQR8jyRO4eE2fWhsHF5Uk_92BPs1FehHAe_xHNatfJvLhB5wDYYUKJPcajqllRU1GTcCoCNCSSTwVPhMgOWlcDZDrmqgdSUuS2tcLIKEnvz9Bgc5EXy9bt1P7IsbqaVOya756nWGCRtc Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: f351a73d1a584b2e9f51c4a86dfff0e3 Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-DeleteServersTestJSON-155994710 Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:22:07.168552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:22:07.170085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f351a73d1a584b2e9f51c4a86dfff0e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f351a73d1a584b2e9f51c4a86dfff0e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f351a73d1a584b2e9f51c4a86dfff0e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f351a73d1a584b2e9f51c4a86dfff0e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:22:07.170085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-DeleteServersTestJSON-155994710 Aug 01 14:22:07.170085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: f351a73d1a584b2e9f51c4a86dfff0e3 Aug 01 14:22:07.170085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-DeleteServersTestJSON-155994710 Aug 01 14:22:07.170085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-DeleteServersTestJSON-155994710-project Aug 01 14:22:07.170085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:22:07.170085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:22:07.170085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: ea98d747777d42a5a9192dd2c4746038 Aug 01 14:22:07.170085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-DeleteServersTestJSON-155994710-project Aug 01 14:22:07.170085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:22:07.170085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:07.170085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': 'aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e'} Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:22:07.170909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:07.172446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:07.174665 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-cbb43d15-351e-48bf-8ba3-f1023e8a1296 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Returning 404 to user: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:22:07.175042 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-cbb43d15-351e-48bf-8ba3-f1023e8a1296 tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "DELETE /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 404 len: 111 microversion: 2.1 time: 0.043796 Aug 01 14:22:07.175690 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 112/215] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:22:07 2022] DELETE /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:22:07.184310 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-60c2607e-a9ab-4f93-b0cc-8c4041729e7c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:07.185166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-60c2607e-a9ab-4f93-b0cc-8c4041729e7c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] [instance: aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:07.192014 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-60c2607e-a9ab-4f93-b0cc-8c4041729e7c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:07.192621 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-60c2607e-a9ab-4f93-b0cc-8c4041729e7c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:07.193604 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-60c2607e-a9ab-4f93-b0cc-8c4041729e7c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:07.194166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-60c2607e-a9ab-4f93-b0cc-8c4041729e7c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:07.208618 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-60c2607e-a9ab-4f93-b0cc-8c4041729e7c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] HTTP exception thrown: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-60c2607e-a9ab-4f93-b0cc-8c4041729e7c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Request method failure captured: Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e HTTP/1.1 Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-E1P0RIhrn6-lE1oP12auaWfwV3ylDxjKvCQR8jyRO4eE2fWhsHF5Uk_92BPs1FehHAe_xHNatfJvLhB5wDYYUKJPcajqllRU1GTcCoCNCSSTwVPhMgOWlcDZDrmqgdSUuS2tcLIKEnvz9Bgc5EXy9bt1P7IsbqaVOya756nWGCRtc Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: f351a73d1a584b2e9f51c4a86dfff0e3 Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-DeleteServersTestJSON-155994710 Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:22:07.214516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:22:07.215982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f351a73d1a584b2e9f51c4a86dfff0e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f351a73d1a584b2e9f51c4a86dfff0e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f351a73d1a584b2e9f51c4a86dfff0e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f351a73d1a584b2e9f51c4a86dfff0e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:22:07.215982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-DeleteServersTestJSON-155994710 Aug 01 14:22:07.215982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: f351a73d1a584b2e9f51c4a86dfff0e3 Aug 01 14:22:07.215982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-DeleteServersTestJSON-155994710 Aug 01 14:22:07.215982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-DeleteServersTestJSON-155994710-project Aug 01 14:22:07.215982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:22:07.215982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:22:07.215982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: ea98d747777d42a5a9192dd2c4746038 Aug 01 14:22:07.215982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-DeleteServersTestJSON-155994710-project Aug 01 14:22:07.215982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:22:07.215982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:07.215982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': 'aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e'} Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:22:07.217134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. Aug 01 14:22:07.218781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:22:07.221347 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-60c2607e-a9ab-4f93-b0cc-8c4041729e7c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] Returning 404 to user: Instance aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:22:07.221347 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-60c2607e-a9ab-4f93-b0cc-8c4041729e7c tempest-DeleteServersTestJSON-155994710 tempest-DeleteServersTestJSON-155994710-project] 10.222.0.49 "GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e" status: 404 len: 111 microversion: 2.1 time: 0.038218 Aug 01 14:22:07.221347 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 104/216] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:07 2022] GET /compute/v2.1/servers/aed76e5d-c2ef-41b8-bdfb-fa038bb5a60e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:22:08.166172 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-2ae970c4-2a5d-499b-80f0-497597247455 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:08.166172 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-2ae970c4-2a5d-499b-80f0-497597247455 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:08.172336 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2ae970c4-2a5d-499b-80f0-497597247455 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:08.173026 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2ae970c4-2a5d-499b-80f0-497597247455 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:08.173998 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2ae970c4-2a5d-499b-80f0-497597247455 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:08.174623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2ae970c4-2a5d-499b-80f0-497597247455 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:08.498893 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2ae970c4-2a5d-499b-80f0-497597247455 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:08.508069 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-2ae970c4-2a5d-499b-80f0-497597247455 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.347468 Aug 01 14:22:08.508889 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 113/217] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:08 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:09.530856 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7be77783-821e-4895-96f9-161c50db7522 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:09.531571 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7be77783-821e-4895-96f9-161c50db7522 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:09.540381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7be77783-821e-4895-96f9-161c50db7522 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:09.540839 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7be77783-821e-4895-96f9-161c50db7522 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:09.541624 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7be77783-821e-4895-96f9-161c50db7522 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:09.542187 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7be77783-821e-4895-96f9-161c50db7522 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:09.774054 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7be77783-821e-4895-96f9-161c50db7522 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:09.784884 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7be77783-821e-4895-96f9-161c50db7522 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.258248 Aug 01 14:22:09.806081 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 105/218] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:09 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:10.805721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-44300c0e-3672-4501-8494-b0ff2d9004c3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:10.806356 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-44300c0e-3672-4501-8494-b0ff2d9004c3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:10.813560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-44300c0e-3672-4501-8494-b0ff2d9004c3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:10.814039 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-44300c0e-3672-4501-8494-b0ff2d9004c3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:10.814807 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-44300c0e-3672-4501-8494-b0ff2d9004c3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:10.815301 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-44300c0e-3672-4501-8494-b0ff2d9004c3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:11.137067 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-44300c0e-3672-4501-8494-b0ff2d9004c3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:11.149582 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-44300c0e-3672-4501-8494-b0ff2d9004c3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.348128 Aug 01 14:22:11.151838 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 114/219] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:10 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:12.171276 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-5127c36d-9085-476b-aeb7-2714dd562b08 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:12.172544 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-5127c36d-9085-476b-aeb7-2714dd562b08 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:12.183678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5127c36d-9085-476b-aeb7-2714dd562b08 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:12.184132 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5127c36d-9085-476b-aeb7-2714dd562b08 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:12.186751 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5127c36d-9085-476b-aeb7-2714dd562b08 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:12.190390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5127c36d-9085-476b-aeb7-2714dd562b08 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:12.363099 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-5127c36d-9085-476b-aeb7-2714dd562b08 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:12.374274 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-5127c36d-9085-476b-aeb7-2714dd562b08 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.207267 Aug 01 14:22:12.374854 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 106/220] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:12 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:13.395469 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5c709a3f-cd31-460b-826d-bc804ae4c92f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:13.398796 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5c709a3f-cd31-460b-826d-bc804ae4c92f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:13.411147 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5c709a3f-cd31-460b-826d-bc804ae4c92f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:13.418546 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5c709a3f-cd31-460b-826d-bc804ae4c92f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:13.418546 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5c709a3f-cd31-460b-826d-bc804ae4c92f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:13.418546 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5c709a3f-cd31-460b-826d-bc804ae4c92f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:13.580930 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-5c709a3f-cd31-460b-826d-bc804ae4c92f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:13.589080 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5c709a3f-cd31-460b-826d-bc804ae4c92f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1521 microversion: 2.1 time: 0.198209 Aug 01 14:22:13.591963 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 115/221] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:13 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:14.615254 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-532b0086-d285-4543-b96e-b8deab95eda8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:14.616032 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-532b0086-d285-4543-b96e-b8deab95eda8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:14.623314 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-532b0086-d285-4543-b96e-b8deab95eda8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:14.623842 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-532b0086-d285-4543-b96e-b8deab95eda8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:14.624690 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-532b0086-d285-4543-b96e-b8deab95eda8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:14.625393 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-532b0086-d285-4543-b96e-b8deab95eda8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:14.764128 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-532b0086-d285-4543-b96e-b8deab95eda8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:14.772446 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-532b0086-d285-4543-b96e-b8deab95eda8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1501 microversion: 2.1 time: 0.165492 Aug 01 14:22:14.778043 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 107/222] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:14 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:14.797533 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-2a281f3a-a16b-43c8-ac06-50e2701d2203 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:14.798176 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-2a281f3a-a16b-43c8-ac06-50e2701d2203 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:14.805325 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2a281f3a-a16b-43c8-ac06-50e2701d2203 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:14.805799 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2a281f3a-a16b-43c8-ac06-50e2701d2203 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:14.806581 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2a281f3a-a16b-43c8-ac06-50e2701d2203 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:14.807023 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2a281f3a-a16b-43c8-ac06-50e2701d2203 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:15.091727 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2a281f3a-a16b-43c8-ac06-50e2701d2203 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:15.099334 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-2a281f3a-a16b-43c8-ac06-50e2701d2203 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1515 microversion: 2.1 time: 0.305907 Aug 01 14:22:15.099901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 116/223] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:14 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1515 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:16.876778 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6a6a4790-34b2-4f17-97e1-b5bde5ef6cc7 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] Calling method '.version_select at 0x7fb254270ca0>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:16.936647 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-6a6a4790-34b2-4f17-97e1-b5bde5ef6cc7 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/10357381-c657-4c71-911e-c413d185fa22" status: 200 len: 350 microversion: 2.1 time: 0.063528 Aug 01 14:22:16.941782 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 108/224] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Aug 1 14:22:16 2022] GET /compute/v2.1/os-volumes/10357381-c657-4c71-911e-c413d185fa22 => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:17.485923 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-53090453-adbd-46d6-8f78-e0b006fc129b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:17.488066 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-53090453-adbd-46d6-8f78-e0b006fc129b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:17.495582 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-53090453-adbd-46d6-8f78-e0b006fc129b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:17.496038 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-53090453-adbd-46d6-8f78-e0b006fc129b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:17.496811 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-53090453-adbd-46d6-8f78-e0b006fc129b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:17.497258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-53090453-adbd-46d6-8f78-e0b006fc129b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:17.521150 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-53090453-adbd-46d6-8f78-e0b006fc129b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lazy-loading 'flavor' on Instance uuid c3824777-d8b1-4993-a19d-921e3054fde8 {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:22:17.875892 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-53090453-adbd-46d6-8f78-e0b006fc129b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "POST /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8/action" status: 200 len: 32 microversion: 2.1 time: 0.394285 Aug 01 14:22:17.876498 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 117/225] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Aug 1 14:22:17 2022] POST /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8/action => generated 32 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:22:17.886459 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7a54ede8-f347-4e15-b972-8dbff0b403e1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:17.887072 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7a54ede8-f347-4e15-b972-8dbff0b403e1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:17.899246 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7a54ede8-f347-4e15-b972-8dbff0b403e1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:17.899246 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7a54ede8-f347-4e15-b972-8dbff0b403e1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:17.899246 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7a54ede8-f347-4e15-b972-8dbff0b403e1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:17.899604 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7a54ede8-f347-4e15-b972-8dbff0b403e1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:18.103570 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7a54ede8-f347-4e15-b972-8dbff0b403e1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:18.114310 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7a54ede8-f347-4e15-b972-8dbff0b403e1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.232019 Aug 01 14:22:18.119913 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 109/226] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:17 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:19.138805 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4b067649-85b9-412a-b710-b588e982925e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:19.140063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4b067649-85b9-412a-b710-b588e982925e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:19.147321 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4b067649-85b9-412a-b710-b588e982925e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:19.147784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4b067649-85b9-412a-b710-b588e982925e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:19.148559 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4b067649-85b9-412a-b710-b588e982925e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:19.148998 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4b067649-85b9-412a-b710-b588e982925e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:19.186349 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-70f7c2f5-6653-42cb-83c6-5094d6bf1362 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] Calling method '.version_select at 0x7fb254374280>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:19.235413 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-70f7c2f5-6653-42cb-83c6-5094d6bf1362 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/9c302d4d-6265-4d07-818d-cc89eaeb0006" status: 200 len: 350 microversion: 2.1 time: 0.052727 Aug 01 14:22:19.236116 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 110/227] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Aug 1 14:22:19 2022] GET /compute/v2.1/os-volumes/9c302d4d-6265-4d07-818d-cc89eaeb0006 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:22:19.301217 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4b067649-85b9-412a-b710-b588e982925e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:19.309210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4b067649-85b9-412a-b710-b588e982925e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.175584 Aug 01 14:22:19.309888 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 118/228] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:19 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:20.330814 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-2e316297-2727-4fe8-af12-7969e7c94c3d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:20.331401 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-2e316297-2727-4fe8-af12-7969e7c94c3d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:20.337330 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2e316297-2727-4fe8-af12-7969e7c94c3d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:20.338443 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2e316297-2727-4fe8-af12-7969e7c94c3d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:20.339274 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2e316297-2727-4fe8-af12-7969e7c94c3d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:20.339707 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2e316297-2727-4fe8-af12-7969e7c94c3d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:20.472567 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2e316297-2727-4fe8-af12-7969e7c94c3d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:20.480416 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-2e316297-2727-4fe8-af12-7969e7c94c3d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.153449 Aug 01 14:22:20.481220 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 111/229] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:20 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:20.979893 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-67860c84-be62-47d6-a975-2857fae66ae8 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] Calling method '.version_select at 0x7fb254420c10>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:21.028595 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-67860c84-be62-47d6-a975-2857fae66ae8 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/98cfe3dc-27be-4fc1-8248-9222f63adac5" status: 200 len: 350 microversion: 2.1 time: 0.052060 Aug 01 14:22:21.029185 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 119/230] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Aug 1 14:22:20 2022] GET /compute/v2.1/os-volumes/98cfe3dc-27be-4fc1-8248-9222f63adac5 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:22:21.041992 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-60d40af6-f3fe-417c-9a56-f889c79f9db5 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] Calling method '.version_select at 0x7fb2544bdf70>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:21.124436 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-60d40af6-f3fe-417c-9a56-f889c79f9db5 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.086228 Aug 01 14:22:21.125011 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 112/231] 10.222.0.49 () {58 vars in 1134 bytes} [Mon Aug 1 14:22:21 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:21.139294 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-449fe46c-3b8e-4a0a-a34a-828487d9b0f9 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] Calling method '.version_select at 0x7fb2542b74c0>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:21.241821 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-449fe46c-3b8e-4a0a-a34a-828487d9b0f9 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.106791 Aug 01 14:22:21.245890 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 120/232] 10.222.0.49 () {58 vars in 1149 bytes} [Mon Aug 1 14:22:21 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:21.256065 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-5adde31c-afee-4184-8b95-0da632841ee8 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] Calling method '.version_select at 0x7fb25428a5e0>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:21.345473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-5adde31c-afee-4184-8b95-0da632841ee8 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.093057 Aug 01 14:22:21.346275 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 113/233] 10.222.0.49 () {58 vars in 1134 bytes} [Mon Aug 1 14:22:21 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:21.359422 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c7d9b511-d29a-4625-897c-0f71e3f21c79 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] Calling method '.version_select at 0x7fb2542a4430>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:21.446731 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c7d9b511-d29a-4625-897c-0f71e3f21c79 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091638 Aug 01 14:22:21.447778 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 121/234] 10.222.0.49 () {58 vars in 1167 bytes} [Mon Aug 1 14:22:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:22:21.463951 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7ac1a917-0f5a-44ea-adf0-5a756bab34f8 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] Calling method '.version_select at 0x7fb254270940>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:21.501743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4de6700d-e0fa-40cf-a9e7-7afb9ce39fc4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:21.502531 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4de6700d-e0fa-40cf-a9e7-7afb9ce39fc4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:21.515937 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4de6700d-e0fa-40cf-a9e7-7afb9ce39fc4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:21.516401 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4de6700d-e0fa-40cf-a9e7-7afb9ce39fc4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:21.517436 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4de6700d-e0fa-40cf-a9e7-7afb9ce39fc4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:21.518120 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4de6700d-e0fa-40cf-a9e7-7afb9ce39fc4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:21.553056 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7ac1a917-0f5a-44ea-adf0-5a756bab34f8 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.095787 Aug 01 14:22:21.553663 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 114/235] 10.222.0.49 () {58 vars in 1170 bytes} [Mon Aug 1 14:22:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:21.566767 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-27b20ef6-1110-4d0e-8c41-5fe1660812ab tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] Calling method '.version_select at 0x7fb25428aaf0>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:21.654510 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-27b20ef6-1110-4d0e-8c41-5fe1660812ab tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.091407 Aug 01 14:22:21.655681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 115/236] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Aug 1 14:22:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:21.669192 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-24852b5d-26f0-4b24-89e5-a7850418d31e tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] Calling method '.version_select at 0x7fb254292b80>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:21.690102 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4de6700d-e0fa-40cf-a9e7-7afb9ce39fc4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:21.698047 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4de6700d-e0fa-40cf-a9e7-7afb9ce39fc4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.200867 Aug 01 14:22:21.698616 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 122/237] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:21 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:21.754423 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-24852b5d-26f0-4b24-89e5-a7850418d31e tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089693 Aug 01 14:22:21.754995 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 116/238] 10.222.0.49 () {58 vars in 1188 bytes} [Mon Aug 1 14:22:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:22:21.772094 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8d3b7f97-ce3c-4007-9e40-e4cc82c561f4 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] Calling method '.version_select at 0x7fb25427ca60>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:21.863047 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8d3b7f97-ce3c-4007-9e40-e4cc82c561f4 tempest-VolumesTestJSON-1954135211 tempest-VolumesTestJSON-1954135211-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.095135 Aug 01 14:22:21.863779 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 123/239] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Aug 1 14:22:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:22.719018 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f18e70cb-31c0-422f-9266-5704be1ee014 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:22.719672 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f18e70cb-31c0-422f-9266-5704be1ee014 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:22.726989 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f18e70cb-31c0-422f-9266-5704be1ee014 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:22.727442 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f18e70cb-31c0-422f-9266-5704be1ee014 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:22.728375 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f18e70cb-31c0-422f-9266-5704be1ee014 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:22.728778 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f18e70cb-31c0-422f-9266-5704be1ee014 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:22.876512 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f18e70cb-31c0-422f-9266-5704be1ee014 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:22.884849 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f18e70cb-31c0-422f-9266-5704be1ee014 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.170001 Aug 01 14:22:22.885527 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 117/240] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:22 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:23.915441 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4f767dc4-a71c-41a8-ab7c-e6d5cafa4208 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:23.915441 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4f767dc4-a71c-41a8-ab7c-e6d5cafa4208 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:23.917126 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4f767dc4-a71c-41a8-ab7c-e6d5cafa4208 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:23.917586 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4f767dc4-a71c-41a8-ab7c-e6d5cafa4208 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:23.919297 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4f767dc4-a71c-41a8-ab7c-e6d5cafa4208 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:23.919747 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4f767dc4-a71c-41a8-ab7c-e6d5cafa4208 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:24.109108 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4f767dc4-a71c-41a8-ab7c-e6d5cafa4208 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:24.118118 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4f767dc4-a71c-41a8-ab7c-e6d5cafa4208 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.214354 Aug 01 14:22:24.119219 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 124/241] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:23 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:25.142394 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-20c050fe-1ac2-4db6-9d75-1233237fe5db tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:25.143946 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-20c050fe-1ac2-4db6-9d75-1233237fe5db tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:25.150924 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-20c050fe-1ac2-4db6-9d75-1233237fe5db tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:25.151477 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-20c050fe-1ac2-4db6-9d75-1233237fe5db tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:25.153579 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-20c050fe-1ac2-4db6-9d75-1233237fe5db tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:25.154215 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-20c050fe-1ac2-4db6-9d75-1233237fe5db tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:25.333111 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-20c050fe-1ac2-4db6-9d75-1233237fe5db tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:25.343527 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-20c050fe-1ac2-4db6-9d75-1233237fe5db tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.206684 Aug 01 14:22:25.344109 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 118/242] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:25 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:25.689641 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-929cb5a7-6c75-4222-96bc-187425c3d57b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:25.690188 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-929cb5a7-6c75-4222-96bc-187425c3d57b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:25.696590 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-929cb5a7-6c75-4222-96bc-187425c3d57b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:25.697109 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-929cb5a7-6c75-4222-96bc-187425c3d57b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:25.697897 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-929cb5a7-6c75-4222-96bc-187425c3d57b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:25.698339 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-929cb5a7-6c75-4222-96bc-187425c3d57b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:25.727526 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-929cb5a7-6c75-4222-96bc-187425c3d57b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/ips" status: 200 len: 152 microversion: 2.20 time: 0.041647 Aug 01 14:22:25.728072 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 125/243] 10.222.0.49 () {60 vars in 1289 bytes} [Mon Aug 1 14:22:25 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:22:26.364659 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a0a052c3-6e59-4695-9dba-90cd51e7c96a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:26.365289 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a0a052c3-6e59-4695-9dba-90cd51e7c96a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:26.372822 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a0a052c3-6e59-4695-9dba-90cd51e7c96a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:26.379436 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a0a052c3-6e59-4695-9dba-90cd51e7c96a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:26.380281 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a0a052c3-6e59-4695-9dba-90cd51e7c96a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:26.380725 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a0a052c3-6e59-4695-9dba-90cd51e7c96a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:26.529222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a0a052c3-6e59-4695-9dba-90cd51e7c96a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:26.542038 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a0a052c3-6e59-4695-9dba-90cd51e7c96a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.177044 Aug 01 14:22:26.542038 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 119/244] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:26 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:27.563646 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-be84273c-ccb5-49a4-9bc9-2c67e56a1b97 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:27.564819 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-be84273c-ccb5-49a4-9bc9-2c67e56a1b97 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:27.571214 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-be84273c-ccb5-49a4-9bc9-2c67e56a1b97 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:27.571670 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-be84273c-ccb5-49a4-9bc9-2c67e56a1b97 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:27.572445 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-be84273c-ccb5-49a4-9bc9-2c67e56a1b97 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:27.573050 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-be84273c-ccb5-49a4-9bc9-2c67e56a1b97 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:27.725395 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-be84273c-ccb5-49a4-9bc9-2c67e56a1b97 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:27.733909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-be84273c-ccb5-49a4-9bc9-2c67e56a1b97 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.174340 Aug 01 14:22:27.734494 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 126/245] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:27 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:28.756011 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d1aa1bb2-4d12-441f-830b-d59809115173 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:28.756741 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d1aa1bb2-4d12-441f-830b-d59809115173 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:28.764302 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d1aa1bb2-4d12-441f-830b-d59809115173 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:28.764746 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d1aa1bb2-4d12-441f-830b-d59809115173 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:28.765740 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d1aa1bb2-4d12-441f-830b-d59809115173 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:28.766530 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d1aa1bb2-4d12-441f-830b-d59809115173 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:28.813315 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b86eb2b9-c633-4cc3-a565-4b72303686d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:28.813891 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b86eb2b9-c633-4cc3-a565-4b72303686d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:28.821820 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b86eb2b9-c633-4cc3-a565-4b72303686d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:28.822305 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b86eb2b9-c633-4cc3-a565-4b72303686d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:28.823090 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b86eb2b9-c633-4cc3-a565-4b72303686d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:28.823533 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b86eb2b9-c633-4cc3-a565-4b72303686d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:28.857678 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-b86eb2b9-c633-4cc3-a565-4b72303686d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lazy-loading 'flavor' on Instance uuid 9c41c564-40f2-47cf-820b-915c3d43ccb3 {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:22:28.916525 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d1aa1bb2-4d12-441f-830b-d59809115173 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:28.931047 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d1aa1bb2-4d12-441f-830b-d59809115173 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.178890 Aug 01 14:22:28.931667 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 120/246] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:28 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:28.990955 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:29.958749 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-adfeedee-3e78-4e3f-b513-e2c34c34954a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:29.959365 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-adfeedee-3e78-4e3f-b513-e2c34c34954a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:29.966416 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-adfeedee-3e78-4e3f-b513-e2c34c34954a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:29.966863 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-adfeedee-3e78-4e3f-b513-e2c34c34954a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:29.967633 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-adfeedee-3e78-4e3f-b513-e2c34c34954a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:29.968061 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-adfeedee-3e78-4e3f-b513-e2c34c34954a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:30.124208 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-adfeedee-3e78-4e3f-b513-e2c34c34954a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:30.133457 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-adfeedee-3e78-4e3f-b513-e2c34c34954a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.178804 Aug 01 14:22:30.134792 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 121/247] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:29 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:31.156982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-daacd05e-4c28-4cef-a5e1-d9f8a1f95dc2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:31.157735 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-daacd05e-4c28-4cef-a5e1-d9f8a1f95dc2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:31.163385 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=32 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:31.165723 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-daacd05e-4c28-4cef-a5e1-d9f8a1f95dc2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:31.166208 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-daacd05e-4c28-4cef-a5e1-d9f8a1f95dc2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:31.169101 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-daacd05e-4c28-4cef-a5e1-d9f8a1f95dc2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:31.169101 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-daacd05e-4c28-4cef-a5e1-d9f8a1f95dc2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:31.171652 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=97 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:31.317280 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-daacd05e-4c28-4cef-a5e1-d9f8a1f95dc2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:31.325040 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-daacd05e-4c28-4cef-a5e1-d9f8a1f95dc2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.172713 Aug 01 14:22:31.325585 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 122/248] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:31 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:32.346943 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c2f623e3-3de9-41eb-8748-71d6e1591c96 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:32.347726 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c2f623e3-3de9-41eb-8748-71d6e1591c96 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:32.354368 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c2f623e3-3de9-41eb-8748-71d6e1591c96 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:32.354831 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c2f623e3-3de9-41eb-8748-71d6e1591c96 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:32.355755 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c2f623e3-3de9-41eb-8748-71d6e1591c96 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:32.356189 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c2f623e3-3de9-41eb-8748-71d6e1591c96 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:32.545934 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c2f623e3-3de9-41eb-8748-71d6e1591c96 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:32.553911 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c2f623e3-3de9-41eb-8748-71d6e1591c96 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.210794 Aug 01 14:22:32.554501 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 123/249] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:32 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:33.577572 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-5d731f1b-1dc2-41e1-98ce-af41edda4f20 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:33.578944 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-5d731f1b-1dc2-41e1-98ce-af41edda4f20 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:33.591056 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5d731f1b-1dc2-41e1-98ce-af41edda4f20 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:33.591637 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5d731f1b-1dc2-41e1-98ce-af41edda4f20 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:33.592411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5d731f1b-1dc2-41e1-98ce-af41edda4f20 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:33.592948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5d731f1b-1dc2-41e1-98ce-af41edda4f20 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:33.819379 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-5d731f1b-1dc2-41e1-98ce-af41edda4f20 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:33.832638 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-5d731f1b-1dc2-41e1-98ce-af41edda4f20 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.260749 Aug 01 14:22:33.833479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 124/250] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:33 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:33.838340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-8f2fd673-8397-4f58-983a-889893d17934 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:33.838944 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-8f2fd673-8397-4f58-983a-889893d17934 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:33.845979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8f2fd673-8397-4f58-983a-889893d17934 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:33.846423 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8f2fd673-8397-4f58-983a-889893d17934 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:33.847194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8f2fd673-8397-4f58-983a-889893d17934 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:33.847629 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8f2fd673-8397-4f58-983a-889893d17934 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:33.872102 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-8f2fd673-8397-4f58-983a-889893d17934 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/ips" status: 200 len: 146 microversion: 2.1 time: 0.037370 Aug 01 14:22:33.874126 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 125/251] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Aug 1 14:22:33 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:34.099146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b86eb2b9-c633-4cc3-a565-4b72303686d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "POST /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/action" status: 202 len: 0 microversion: 2.20 time: 5.290049 Aug 01 14:22:34.103014 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 127/252] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Aug 1 14:22:28 2022] POST /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/action => generated 0 bytes in 5292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:22:34.109029 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d98ac13b-16bb-4abb-988e-63ad572ff4ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:34.109997 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d98ac13b-16bb-4abb-988e-63ad572ff4ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:34.117342 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d98ac13b-16bb-4abb-988e-63ad572ff4ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:34.117823 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d98ac13b-16bb-4abb-988e-63ad572ff4ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:34.118604 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d98ac13b-16bb-4abb-988e-63ad572ff4ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:34.119311 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d98ac13b-16bb-4abb-988e-63ad572ff4ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:34.256663 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d98ac13b-16bb-4abb-988e-63ad572ff4ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:34.265667 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d98ac13b-16bb-4abb-988e-63ad572ff4ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:34.267294 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d98ac13b-16bb-4abb-988e-63ad572ff4ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:34.268524 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d98ac13b-16bb-4abb-988e-63ad572ff4ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.164237 Aug 01 14:22:34.269053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 126/253] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:34 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:34.860568 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-acda85f5-1b83-4fcb-a087-5e5e3d9c0a42 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:34.861264 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-acda85f5-1b83-4fcb-a087-5e5e3d9c0a42 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:34.863665 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=28 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:34.878384 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-acda85f5-1b83-4fcb-a087-5e5e3d9c0a42 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:34.878384 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-acda85f5-1b83-4fcb-a087-5e5e3d9c0a42 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:34.878384 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-acda85f5-1b83-4fcb-a087-5e5e3d9c0a42 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:34.878384 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-acda85f5-1b83-4fcb-a087-5e5e3d9c0a42 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:35.025274 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-acda85f5-1b83-4fcb-a087-5e5e3d9c0a42 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:35.033503 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-acda85f5-1b83-4fcb-a087-5e5e3d9c0a42 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.177782 Aug 01 14:22:35.034104 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 128/254] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:34 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:35.292302 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1782c921-e75a-4fae-abb9-cadb57f49404 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:35.293556 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1782c921-e75a-4fae-abb9-cadb57f49404 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:35.300461 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1782c921-e75a-4fae-abb9-cadb57f49404 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:35.300932 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1782c921-e75a-4fae-abb9-cadb57f49404 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:35.301685 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1782c921-e75a-4fae-abb9-cadb57f49404 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:35.302196 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1782c921-e75a-4fae-abb9-cadb57f49404 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:35.455825 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1782c921-e75a-4fae-abb9-cadb57f49404 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:35.464058 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1782c921-e75a-4fae-abb9-cadb57f49404 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:35.465638 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1782c921-e75a-4fae-abb9-cadb57f49404 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:35.466867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1782c921-e75a-4fae-abb9-cadb57f49404 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.178519 Aug 01 14:22:35.475117 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 127/255] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:35 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:36.054641 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4ca639c2-61d5-4b1a-8652-2896e961daa8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:36.055251 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4ca639c2-61d5-4b1a-8652-2896e961daa8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:36.061831 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4ca639c2-61d5-4b1a-8652-2896e961daa8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:36.062283 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4ca639c2-61d5-4b1a-8652-2896e961daa8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:36.063087 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4ca639c2-61d5-4b1a-8652-2896e961daa8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:36.063597 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4ca639c2-61d5-4b1a-8652-2896e961daa8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:36.238847 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4ca639c2-61d5-4b1a-8652-2896e961daa8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:36.247286 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4ca639c2-61d5-4b1a-8652-2896e961daa8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.196576 Aug 01 14:22:36.249499 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 129/256] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:36 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:36.490374 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-27f72747-bed2-486c-adfb-7659dedf9927 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:36.491241 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-27f72747-bed2-486c-adfb-7659dedf9927 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:36.498255 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-27f72747-bed2-486c-adfb-7659dedf9927 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:36.499022 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-27f72747-bed2-486c-adfb-7659dedf9927 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:36.500046 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-27f72747-bed2-486c-adfb-7659dedf9927 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:36.500592 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-27f72747-bed2-486c-adfb-7659dedf9927 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:36.641694 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-27f72747-bed2-486c-adfb-7659dedf9927 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:36.650126 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-27f72747-bed2-486c-adfb-7659dedf9927 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:36.651626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-27f72747-bed2-486c-adfb-7659dedf9927 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:36.652817 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-27f72747-bed2-486c-adfb-7659dedf9927 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.166530 Aug 01 14:22:36.653383 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 128/257] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:36 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:37.273609 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-9f0a6bc3-68fd-4655-88aa-09d95ff35891 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:37.273609 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-9f0a6bc3-68fd-4655-88aa-09d95ff35891 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:37.275615 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9f0a6bc3-68fd-4655-88aa-09d95ff35891 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.276069 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9f0a6bc3-68fd-4655-88aa-09d95ff35891 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.277382 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9f0a6bc3-68fd-4655-88aa-09d95ff35891 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.277850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9f0a6bc3-68fd-4655-88aa-09d95ff35891 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.418596 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-9f0a6bc3-68fd-4655-88aa-09d95ff35891 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:37.426965 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-9f0a6bc3-68fd-4655-88aa-09d95ff35891 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.162462 Aug 01 14:22:37.427702 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 130/258] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:37 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:37.676146 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-15e090c8-c057-492a-8426-6031455d88fb tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:37.676751 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-15e090c8-c057-492a-8426-6031455d88fb tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:37.682797 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-15e090c8-c057-492a-8426-6031455d88fb tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.684423 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-15e090c8-c057-492a-8426-6031455d88fb tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.685197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-15e090c8-c057-492a-8426-6031455d88fb tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.685666 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-15e090c8-c057-492a-8426-6031455d88fb tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.819204 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-15e090c8-c057-492a-8426-6031455d88fb tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:37.828591 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-15e090c8-c057-492a-8426-6031455d88fb tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:37.830693 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-15e090c8-c057-492a-8426-6031455d88fb tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:37.832054 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-15e090c8-c057-492a-8426-6031455d88fb tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.160428 Aug 01 14:22:37.832940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 129/259] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:37 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:38.451227 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3686d766-3318-4cee-b717-2807d48d3c5f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:38.451999 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3686d766-3318-4cee-b717-2807d48d3c5f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:38.460175 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3686d766-3318-4cee-b717-2807d48d3c5f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:38.462828 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3686d766-3318-4cee-b717-2807d48d3c5f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:38.462828 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3686d766-3318-4cee-b717-2807d48d3c5f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:38.462828 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3686d766-3318-4cee-b717-2807d48d3c5f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:38.519527 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-977c34f9-b225-40b0-9513-0afe1895ce54 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1901312606", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452", "networks": [{"uuid": "94f6cc2e-7bf3-42cf-99c8-31d89c32275b"}]}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:38.598509 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3686d766-3318-4cee-b717-2807d48d3c5f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:38.606657 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3686d766-3318-4cee-b717-2807d48d3c5f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.160480 Aug 01 14:22:38.607248 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 131/260] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:38 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:38.858935 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e0219ecd-6e80-44af-9351-d9ae793c277b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:38.858935 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e0219ecd-6e80-44af-9351-d9ae793c277b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:38.863454 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e0219ecd-6e80-44af-9351-d9ae793c277b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:38.863961 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e0219ecd-6e80-44af-9351-d9ae793c277b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:38.870457 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e0219ecd-6e80-44af-9351-d9ae793c277b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:38.870457 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e0219ecd-6e80-44af-9351-d9ae793c277b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:39.000905 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e0219ecd-6e80-44af-9351-d9ae793c277b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:39.010265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e0219ecd-6e80-44af-9351-d9ae793c277b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:39.012469 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e0219ecd-6e80-44af-9351-d9ae793c277b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:39.013651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e0219ecd-6e80-44af-9351-d9ae793c277b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.161757 Aug 01 14:22:39.025084 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 132/261] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:38 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:39.299563 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-2f6267de-9e4e-4d2a-8ab9-9bcc29027f44 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fdfd3a4-1a6c-41d0-b3c2-93b528023b35"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:39.301975 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-2f6267de-9e4e-4d2a-8ab9-9bcc29027f44 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:39.308771 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2f6267de-9e4e-4d2a-8ab9-9bcc29027f44 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:39.309717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2f6267de-9e4e-4d2a-8ab9-9bcc29027f44 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:39.310488 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2f6267de-9e4e-4d2a-8ab9-9bcc29027f44 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:39.310924 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2f6267de-9e4e-4d2a-8ab9-9bcc29027f44 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:40.309641 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-2f6267de-9e4e-4d2a-8ab9-9bcc29027f44 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "POST /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.013736 Aug 01 14:22:40.310357 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 133/262] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Aug 1 14:22:39 2022] POST /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/os-volume_attachments => generated 194 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:22:40.315868 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1daf3b28-2013-4867-9ea0-c2b1b4023163 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:40.316737 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-1daf3b28-2013-4867-9ea0-c2b1b4023163 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:40.323807 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1daf3b28-2013-4867-9ea0-c2b1b4023163 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:40.324260 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1daf3b28-2013-4867-9ea0-c2b1b4023163 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:40.325039 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1daf3b28-2013-4867-9ea0-c2b1b4023163 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:40.325479 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1daf3b28-2013-4867-9ea0-c2b1b4023163 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:40.468091 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-1daf3b28-2013-4867-9ea0-c2b1b4023163 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:40.476598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-1daf3b28-2013-4867-9ea0-c2b1b4023163 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.164943 Aug 01 14:22:40.477439 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 134/263] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:40 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:40.482710 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-02b19448-99de-4a54-b541-a52007e392ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:40.483323 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-02b19448-99de-4a54-b541-a52007e392ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:40.489379 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-02b19448-99de-4a54-b541-a52007e392ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:40.496795 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-02b19448-99de-4a54-b541-a52007e392ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:40.496795 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-02b19448-99de-4a54-b541-a52007e392ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:40.496795 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-02b19448-99de-4a54-b541-a52007e392ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:40.623903 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-02b19448-99de-4a54-b541-a52007e392ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:40.632332 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-02b19448-99de-4a54-b541-a52007e392ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:40.633870 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-02b19448-99de-4a54-b541-a52007e392ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:40.635145 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-02b19448-99de-4a54-b541-a52007e392ce tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.156717 Aug 01 14:22:40.635711 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 135/264] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:40 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:41.499174 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-33fb39ee-8bcd-4a09-a88b-b7813bc060a1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:41.499940 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-33fb39ee-8bcd-4a09-a88b-b7813bc060a1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:41.507508 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-33fb39ee-8bcd-4a09-a88b-b7813bc060a1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:41.507928 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-33fb39ee-8bcd-4a09-a88b-b7813bc060a1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.508844 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-33fb39ee-8bcd-4a09-a88b-b7813bc060a1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:41.509357 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-33fb39ee-8bcd-4a09-a88b-b7813bc060a1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.647052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-33fb39ee-8bcd-4a09-a88b-b7813bc060a1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:41.655574 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-33fb39ee-8bcd-4a09-a88b-b7813bc060a1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.160309 Aug 01 14:22:41.656180 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 136/265] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:41 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:41.660686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0161004a-c7b1-4851-b0fc-4318df703e67 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:41.661282 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0161004a-c7b1-4851-b0fc-4318df703e67 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:41.668763 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0161004a-c7b1-4851-b0fc-4318df703e67 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:41.669382 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0161004a-c7b1-4851-b0fc-4318df703e67 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.670256 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0161004a-c7b1-4851-b0fc-4318df703e67 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:41.670730 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0161004a-c7b1-4851-b0fc-4318df703e67 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.810952 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-0161004a-c7b1-4851-b0fc-4318df703e67 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:41.818790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-0161004a-c7b1-4851-b0fc-4318df703e67 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:41.820294 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-0161004a-c7b1-4851-b0fc-4318df703e67 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:41.821444 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0161004a-c7b1-4851-b0fc-4318df703e67 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.164347 Aug 01 14:22:41.822033 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 137/266] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:41 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:42.683452 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c30adb3c-710e-4a6e-8c5b-a117e482766d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:42.683452 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c30adb3c-710e-4a6e-8c5b-a117e482766d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:42.689601 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c30adb3c-710e-4a6e-8c5b-a117e482766d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:42.690265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c30adb3c-710e-4a6e-8c5b-a117e482766d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:42.691096 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c30adb3c-710e-4a6e-8c5b-a117e482766d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:42.691544 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c30adb3c-710e-4a6e-8c5b-a117e482766d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:42.831944 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c30adb3c-710e-4a6e-8c5b-a117e482766d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:42.839468 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c30adb3c-710e-4a6e-8c5b-a117e482766d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.165020 Aug 01 14:22:42.840762 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 138/267] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:42 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:42.845801 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1ba55e6a-2922-4a86-b165-f51b1950800c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:42.848999 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-1ba55e6a-2922-4a86-b165-f51b1950800c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:42.853214 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1ba55e6a-2922-4a86-b165-f51b1950800c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:42.853689 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1ba55e6a-2922-4a86-b165-f51b1950800c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:42.854564 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1ba55e6a-2922-4a86-b165-f51b1950800c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:42.855019 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1ba55e6a-2922-4a86-b165-f51b1950800c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:42.957705 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.network.neutron [None req-977c34f9-b225-40b0-9513-0afe1895ce54 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] validate_networks() for [('94f6cc2e-7bf3-42cf-99c8-31d89c32275b', None, None, None, None, None)] {{(pid=118247) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:22:43.273791 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-1ba55e6a-2922-4a86-b165-f51b1950800c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:43.284571 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-1ba55e6a-2922-4a86-b165-f51b1950800c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:43.286884 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-1ba55e6a-2922-4a86-b165-f51b1950800c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:43.288215 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-1ba55e6a-2922-4a86-b165-f51b1950800c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.446496 Aug 01 14:22:43.289132 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 139/268] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:42 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:43.583220 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-977c34f9-b225-40b0-9513-0afe1895ce54 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Flavor limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:22:43.583720 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-977c34f9-b225-40b0-9513-0afe1895ce54 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Image limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:22:43.584281 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-977c34f9-b225-40b0-9513-0afe1895ce54 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Flavor pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:22:43.584766 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-977c34f9-b225-40b0-9513-0afe1895ce54 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Image pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:22:43.585258 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-977c34f9-b225-40b0-9513-0afe1895ce54 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:22:43.595840 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-977c34f9-b225-40b0-9513-0afe1895ce54 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.596384 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-977c34f9-b225-40b0-9513-0afe1895ce54 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.597524 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-977c34f9-b225-40b0-9513-0afe1895ce54 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.598062 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-977c34f9-b225-40b0-9513-0afe1895ce54 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.618086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-977c34f9-b225-40b0-9513-0afe1895ce54 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Getting quotas for project 714cc98080ae4baaa11b8b946c67ba2c. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:22:43.636635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-977c34f9-b225-40b0-9513-0afe1895ce54 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Getting quotas for user 0097e07390144f3a804eb5057c6b75e5 and project 714cc98080ae4baaa11b8b946c67ba2c. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:22:43.650323 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-977c34f9-b225-40b0-9513-0afe1895ce54 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Going to run 1 instances... {{(pid=118247) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:22:43.652926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-977c34f9-b225-40b0-9513-0afe1895ce54 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118247) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:22:43.757092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-977c34f9-b225-40b0-9513-0afe1895ce54 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.241413 Aug 01 14:22:43.757948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 130/269] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:22:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 5243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 14:22:43.769814 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-336e1f0b-5e32-4e79-9dc8-f6f97b2f6247 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:43.774740 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-336e1f0b-5e32-4e79-9dc8-f6f97b2f6247 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:43.839036 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-336e1f0b-5e32-4e79-9dc8-f6f97b2f6247 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:43.847437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-336e1f0b-5e32-4e79-9dc8-f6f97b2f6247 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1219 microversion: 2.1 time: 0.082407 Aug 01 14:22:43.848376 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 140/270] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:43 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:43.872926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1e273cc1-8b06-4893-8b52-35e72b2dcbf0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:43.876323 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1e273cc1-8b06-4893-8b52-35e72b2dcbf0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:43.884414 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1e273cc1-8b06-4893-8b52-35e72b2dcbf0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.886101 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1e273cc1-8b06-4893-8b52-35e72b2dcbf0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.887994 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1e273cc1-8b06-4893-8b52-35e72b2dcbf0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.889244 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1e273cc1-8b06-4893-8b52-35e72b2dcbf0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:44.055671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1e273cc1-8b06-4893-8b52-35e72b2dcbf0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:44.063280 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1e273cc1-8b06-4893-8b52-35e72b2dcbf0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.204523 Aug 01 14:22:44.063844 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 131/271] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:43 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:44.311214 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-dab26f1b-34ce-47df-8593-dd83901b696c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:44.312295 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-dab26f1b-34ce-47df-8593-dd83901b696c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:44.318400 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dab26f1b-34ce-47df-8593-dd83901b696c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:44.318858 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dab26f1b-34ce-47df-8593-dd83901b696c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:44.319872 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dab26f1b-34ce-47df-8593-dd83901b696c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:44.320176 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dab26f1b-34ce-47df-8593-dd83901b696c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:44.461355 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-dab26f1b-34ce-47df-8593-dd83901b696c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:44.470711 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-dab26f1b-34ce-47df-8593-dd83901b696c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:44.474870 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-dab26f1b-34ce-47df-8593-dd83901b696c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:44.474870 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-dab26f1b-34ce-47df-8593-dd83901b696c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.167114 Aug 01 14:22:44.489851 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 141/272] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:44 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:44.869019 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3e96e12b-fb46-4e40-98f8-99883f842d0b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:44.869894 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3e96e12b-fb46-4e40-98f8-99883f842d0b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:44.876490 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3e96e12b-fb46-4e40-98f8-99883f842d0b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:44.877011 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3e96e12b-fb46-4e40-98f8-99883f842d0b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:44.877966 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3e96e12b-fb46-4e40-98f8-99883f842d0b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:44.878475 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3e96e12b-fb46-4e40-98f8-99883f842d0b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:44.947870 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3e96e12b-fb46-4e40-98f8-99883f842d0b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:44.957301 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3e96e12b-fb46-4e40-98f8-99883f842d0b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1223 microversion: 2.1 time: 0.092396 Aug 01 14:22:44.957919 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 132/273] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:44 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:45.084276 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-dd0903de-f69b-409b-b5d2-e3af89512b89 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:45.084892 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-dd0903de-f69b-409b-b5d2-e3af89512b89 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:45.092175 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dd0903de-f69b-409b-b5d2-e3af89512b89 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.092626 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dd0903de-f69b-409b-b5d2-e3af89512b89 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.097810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dd0903de-f69b-409b-b5d2-e3af89512b89 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.097810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dd0903de-f69b-409b-b5d2-e3af89512b89 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.241000 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-dd0903de-f69b-409b-b5d2-e3af89512b89 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:45.245264 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:45.249968 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-dd0903de-f69b-409b-b5d2-e3af89512b89 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.169471 Aug 01 14:22:45.250545 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 142/274] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:45 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:45.501674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f2bc644c-b2a1-4b84-a52f-96820402a708 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:45.502382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f2bc644c-b2a1-4b84-a52f-96820402a708 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:45.511559 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f2bc644c-b2a1-4b84-a52f-96820402a708 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.512223 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f2bc644c-b2a1-4b84-a52f-96820402a708 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.513266 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f2bc644c-b2a1-4b84-a52f-96820402a708 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.513912 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f2bc644c-b2a1-4b84-a52f-96820402a708 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.672344 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f2bc644c-b2a1-4b84-a52f-96820402a708 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:45.680317 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f2bc644c-b2a1-4b84-a52f-96820402a708 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:45.681884 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f2bc644c-b2a1-4b84-a52f-96820402a708 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:45.683190 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f2bc644c-b2a1-4b84-a52f-96820402a708 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.186648 Aug 01 14:22:45.684897 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 133/275] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:45 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:45.979654 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-21aceadb-4227-4dfd-91cd-3ae43b46eefc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:45.980309 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-21aceadb-4227-4dfd-91cd-3ae43b46eefc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:45.988291 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-21aceadb-4227-4dfd-91cd-3ae43b46eefc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.988873 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-21aceadb-4227-4dfd-91cd-3ae43b46eefc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.989725 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-21aceadb-4227-4dfd-91cd-3ae43b46eefc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.990402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-21aceadb-4227-4dfd-91cd-3ae43b46eefc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:46.054777 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-21aceadb-4227-4dfd-91cd-3ae43b46eefc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:46.062150 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-21aceadb-4227-4dfd-91cd-3ae43b46eefc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1271 microversion: 2.1 time: 0.086873 Aug 01 14:22:46.062710 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 143/276] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:45 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:46.287633 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-93dc7c6b-cd4b-4716-a66f-0edccfdc7625 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:46.288237 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-93dc7c6b-cd4b-4716-a66f-0edccfdc7625 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:46.302338 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-93dc7c6b-cd4b-4716-a66f-0edccfdc7625 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:46.302793 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-93dc7c6b-cd4b-4716-a66f-0edccfdc7625 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:46.303606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-93dc7c6b-cd4b-4716-a66f-0edccfdc7625 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:46.304036 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-93dc7c6b-cd4b-4716-a66f-0edccfdc7625 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:46.493233 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-93dc7c6b-cd4b-4716-a66f-0edccfdc7625 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:46.502685 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-93dc7c6b-cd4b-4716-a66f-0edccfdc7625 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.225353 Aug 01 14:22:46.504085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 134/277] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:46 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:46.708439 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-13b1b732-2b13-42ce-9b32-88e61ad5c101 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:46.709057 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-13b1b732-2b13-42ce-9b32-88e61ad5c101 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:46.716804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-13b1b732-2b13-42ce-9b32-88e61ad5c101 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:46.717265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-13b1b732-2b13-42ce-9b32-88e61ad5c101 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:46.718317 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-13b1b732-2b13-42ce-9b32-88e61ad5c101 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:46.718933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-13b1b732-2b13-42ce-9b32-88e61ad5c101 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:46.895373 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-13b1b732-2b13-42ce-9b32-88e61ad5c101 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:46.905928 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-13b1b732-2b13-42ce-9b32-88e61ad5c101 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:46.908698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-13b1b732-2b13-42ce-9b32-88e61ad5c101 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:46.910070 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-13b1b732-2b13-42ce-9b32-88e61ad5c101 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.205791 Aug 01 14:22:46.923746 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 144/278] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:46 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:47.084009 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ef896e09-1833-4167-8ee0-43fbb0471b28 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:47.084867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ef896e09-1833-4167-8ee0-43fbb0471b28 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:47.091614 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ef896e09-1833-4167-8ee0-43fbb0471b28 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.092145 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ef896e09-1833-4167-8ee0-43fbb0471b28 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.092995 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ef896e09-1833-4167-8ee0-43fbb0471b28 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.093448 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ef896e09-1833-4167-8ee0-43fbb0471b28 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.250900 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ef896e09-1833-4167-8ee0-43fbb0471b28 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:47.259219 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ef896e09-1833-4167-8ee0-43fbb0471b28 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1319 microversion: 2.1 time: 0.179062 Aug 01 14:22:47.259979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 135/279] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:47 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:47.526453 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8d5bdd70-bca3-4121-997a-76b1b1434e54 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:47.527186 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8d5bdd70-bca3-4121-997a-76b1b1434e54 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:47.534024 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8d5bdd70-bca3-4121-997a-76b1b1434e54 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.534542 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8d5bdd70-bca3-4121-997a-76b1b1434e54 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.536307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8d5bdd70-bca3-4121-997a-76b1b1434e54 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.536823 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8d5bdd70-bca3-4121-997a-76b1b1434e54 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.699531 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8d5bdd70-bca3-4121-997a-76b1b1434e54 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:47.712153 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8d5bdd70-bca3-4121-997a-76b1b1434e54 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.188668 Aug 01 14:22:47.716116 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 145/280] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:47 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:47.940942 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7377d708-9261-4d58-97d0-955707537add tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:47.941585 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7377d708-9261-4d58-97d0-955707537add tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:47.948120 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7377d708-9261-4d58-97d0-955707537add tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.948573 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7377d708-9261-4d58-97d0-955707537add tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.950264 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7377d708-9261-4d58-97d0-955707537add tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.950708 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7377d708-9261-4d58-97d0-955707537add tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:48.098972 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7377d708-9261-4d58-97d0-955707537add tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:48.108579 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7377d708-9261-4d58-97d0-955707537add tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:48.110121 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7377d708-9261-4d58-97d0-955707537add tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:48.111323 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7377d708-9261-4d58-97d0-955707537add tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.178649 Aug 01 14:22:48.111920 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 136/281] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:47 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:48.212442 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-d9ec747c-6e80-446a-865c-3dfb5c4a2077 req-408e42c0-2150-4ee5-b862-7d4867861762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b499d85-fa7b-4fa0-b970-87213e327ef5", "tag": "545f2703-552c-4f53-95c9-72930069a993"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:48.223188 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-d9ec747c-6e80-446a-865c-3dfb5c4a2077 req-408e42c0-2150-4ee5-b862-7d4867861762 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:48.223718 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-d9ec747c-6e80-446a-865c-3dfb5c4a2077 req-408e42c0-2150-4ee5-b862-7d4867861762 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:48.235347 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-d9ec747c-6e80-446a-865c-3dfb5c4a2077 req-408e42c0-2150-4ee5-b862-7d4867861762 service nova] Creating event network-changed:545f2703-552c-4f53-95c9-72930069a993 for instance 6b499d85-fa7b-4fa0-b970-87213e327ef5 on hv-cinder-78729 Aug 01 14:22:48.240450 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-d9ec747c-6e80-446a-865c-3dfb5c4a2077 req-408e42c0-2150-4ee5-b862-7d4867861762 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031768 Aug 01 14:22:48.241040 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 146/282] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:22:48.289369 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-bf22e2c2-8311-44e5-b406-a9e400b82a26 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:48.290219 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-bf22e2c2-8311-44e5-b406-a9e400b82a26 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:48.297670 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bf22e2c2-8311-44e5-b406-a9e400b82a26 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:48.298299 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bf22e2c2-8311-44e5-b406-a9e400b82a26 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:48.299028 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bf22e2c2-8311-44e5-b406-a9e400b82a26 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:48.299465 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bf22e2c2-8311-44e5-b406-a9e400b82a26 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:48.441164 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bf22e2c2-8311-44e5-b406-a9e400b82a26 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:48.448948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-bf22e2c2-8311-44e5-b406-a9e400b82a26 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1319 microversion: 2.1 time: 0.163641 Aug 01 14:22:48.449866 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 137/283] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:48 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:48.737261 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8a96fc74-0473-45ac-82f5-d2fc95dda13f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:48.738064 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8a96fc74-0473-45ac-82f5-d2fc95dda13f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:48.745014 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8a96fc74-0473-45ac-82f5-d2fc95dda13f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:48.745639 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8a96fc74-0473-45ac-82f5-d2fc95dda13f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:48.746865 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8a96fc74-0473-45ac-82f5-d2fc95dda13f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:48.747426 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8a96fc74-0473-45ac-82f5-d2fc95dda13f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:48.926414 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8a96fc74-0473-45ac-82f5-d2fc95dda13f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:48.937059 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8a96fc74-0473-45ac-82f5-d2fc95dda13f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.202693 Aug 01 14:22:48.937059 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 147/284] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:48 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:48.968643 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-81209e68-4502-4c15-8fab-20ff2e743dac tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:48.974990 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-81209e68-4502-4c15-8fab-20ff2e743dac tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:48.975442 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-81209e68-4502-4c15-8fab-20ff2e743dac tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.042786 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-81209e68-4502-4c15-8fab-20ff2e743dac tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Going to try to stop instance {{(pid=118247) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 14:22:49.129288 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:49.140057 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-2625812e-f3f3-47c9-a9d0-054ff77d2b0a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:49.140057 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-2625812e-f3f3-47c9-a9d0-054ff77d2b0a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:49.146060 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2625812e-f3f3-47c9-a9d0-054ff77d2b0a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.148139 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2625812e-f3f3-47c9-a9d0-054ff77d2b0a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.150212 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2625812e-f3f3-47c9-a9d0-054ff77d2b0a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.154531 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2625812e-f3f3-47c9-a9d0-054ff77d2b0a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.244767 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-81209e68-4502-4c15-8fab-20ff2e743dac tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "POST /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/action" status: 202 len: 0 microversion: 2.1 time: 0.280637 Aug 01 14:22:49.245420 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 138/285] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Aug 1 14:22:48 2022] POST /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:22:49.265874 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3ba5015a-6e95-45e8-9064-75c2fc82fb5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:49.266876 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3ba5015a-6e95-45e8-9064-75c2fc82fb5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:49.276340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3ba5015a-6e95-45e8-9064-75c2fc82fb5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.278575 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3ba5015a-6e95-45e8-9064-75c2fc82fb5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.286064 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3ba5015a-6e95-45e8-9064-75c2fc82fb5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.286064 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3ba5015a-6e95-45e8-9064-75c2fc82fb5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.317988 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2625812e-f3f3-47c9-a9d0-054ff77d2b0a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:49.327527 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2625812e-f3f3-47c9-a9d0-054ff77d2b0a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:49.329449 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2625812e-f3f3-47c9-a9d0-054ff77d2b0a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:49.330732 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-2625812e-f3f3-47c9-a9d0-054ff77d2b0a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.197947 Aug 01 14:22:49.331290 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 148/286] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:49 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:49.437085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3ba5015a-6e95-45e8-9064-75c2fc82fb5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:49.445913 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3ba5015a-6e95-45e8-9064-75c2fc82fb5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1723 microversion: 2.1 time: 0.187605 Aug 01 14:22:49.446494 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 139/287] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:49 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:49.471073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-814f9e7d-4807-463b-9f5e-941e7564490b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:49.473699 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-814f9e7d-4807-463b-9f5e-941e7564490b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:49.478405 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-814f9e7d-4807-463b-9f5e-941e7564490b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.478990 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-814f9e7d-4807-463b-9f5e-941e7564490b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.479802 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-814f9e7d-4807-463b-9f5e-941e7564490b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.480813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-814f9e7d-4807-463b-9f5e-941e7564490b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.618148 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-814f9e7d-4807-463b-9f5e-941e7564490b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:49.626025 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-814f9e7d-4807-463b-9f5e-941e7564490b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1319 microversion: 2.1 time: 0.159307 Aug 01 14:22:49.626594 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 149/288] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:49 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:49.959309 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-94180792-9683-4925-9cc9-996b483cded3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:49.959912 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-94180792-9683-4925-9cc9-996b483cded3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:49.966429 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-94180792-9683-4925-9cc9-996b483cded3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.966875 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-94180792-9683-4925-9cc9-996b483cded3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.967896 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-94180792-9683-4925-9cc9-996b483cded3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.968466 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-94180792-9683-4925-9cc9-996b483cded3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.115558 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-94180792-9683-4925-9cc9-996b483cded3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:50.123475 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-94180792-9683-4925-9cc9-996b483cded3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.168027 Aug 01 14:22:50.124036 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 140/289] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:49 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:50.357881 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-45127d48-6eba-446d-98dd-5952833489be tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:50.360017 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-45127d48-6eba-446d-98dd-5952833489be tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:50.367218 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-45127d48-6eba-446d-98dd-5952833489be tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.367668 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-45127d48-6eba-446d-98dd-5952833489be tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.368433 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-45127d48-6eba-446d-98dd-5952833489be tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.369158 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-45127d48-6eba-446d-98dd-5952833489be tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.467996 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-bc9b0c2a-f7e7-452f-845d-5d4a6ae905c0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:50.468751 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-bc9b0c2a-f7e7-452f-845d-5d4a6ae905c0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:50.475302 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bc9b0c2a-f7e7-452f-845d-5d4a6ae905c0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.476012 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bc9b0c2a-f7e7-452f-845d-5d4a6ae905c0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.498913 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bc9b0c2a-f7e7-452f-845d-5d4a6ae905c0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.498913 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bc9b0c2a-f7e7-452f-845d-5d4a6ae905c0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.517237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-45127d48-6eba-446d-98dd-5952833489be tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:50.520870 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-45127d48-6eba-446d-98dd-5952833489be tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:50.522622 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-45127d48-6eba-446d-98dd-5952833489be tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:50.524095 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-45127d48-6eba-446d-98dd-5952833489be tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.171772 Aug 01 14:22:50.527475 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 150/290] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:50 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:50.627237 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bc9b0c2a-f7e7-452f-845d-5d4a6ae905c0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:50.635672 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-bc9b0c2a-f7e7-452f-845d-5d4a6ae905c0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1723 microversion: 2.1 time: 0.171764 Aug 01 14:22:50.636264 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 141/291] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:50 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:50.647953 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8792fe0a-fa12-437a-bf21-1cfedd1499e8 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:50.649199 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8792fe0a-fa12-437a-bf21-1cfedd1499e8 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:50.656836 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8792fe0a-fa12-437a-bf21-1cfedd1499e8 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.657379 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8792fe0a-fa12-437a-bf21-1cfedd1499e8 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.658455 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8792fe0a-fa12-437a-bf21-1cfedd1499e8 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.659010 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8792fe0a-fa12-437a-bf21-1cfedd1499e8 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.813909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8792fe0a-fa12-437a-bf21-1cfedd1499e8 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:50.822185 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8792fe0a-fa12-437a-bf21-1cfedd1499e8 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1319 microversion: 2.1 time: 0.178271 Aug 01 14:22:50.822996 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 151/292] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:50 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:51.145378 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b3dc2255-bd18-4cc0-aa07-f5eab3f86e1f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:51.146367 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b3dc2255-bd18-4cc0-aa07-f5eab3f86e1f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:51.153728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b3dc2255-bd18-4cc0-aa07-f5eab3f86e1f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:51.154300 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b3dc2255-bd18-4cc0-aa07-f5eab3f86e1f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:51.155142 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b3dc2255-bd18-4cc0-aa07-f5eab3f86e1f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:51.155646 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b3dc2255-bd18-4cc0-aa07-f5eab3f86e1f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:51.293919 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b3dc2255-bd18-4cc0-aa07-f5eab3f86e1f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:51.301482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b3dc2255-bd18-4cc0-aa07-f5eab3f86e1f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.161627 Aug 01 14:22:51.302097 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 142/293] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:51 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:51.549536 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-624b9734-8722-4dee-b21a-917f19877368 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:51.550203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-624b9734-8722-4dee-b21a-917f19877368 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:51.556769 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-624b9734-8722-4dee-b21a-917f19877368 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:51.557213 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-624b9734-8722-4dee-b21a-917f19877368 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:51.558007 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-624b9734-8722-4dee-b21a-917f19877368 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:51.558537 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-624b9734-8722-4dee-b21a-917f19877368 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:51.659228 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ba6138d8-8590-4c1b-a7ad-9d9c8e9e97fe tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:51.660244 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ba6138d8-8590-4c1b-a7ad-9d9c8e9e97fe tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:51.666755 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ba6138d8-8590-4c1b-a7ad-9d9c8e9e97fe tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:51.668573 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ba6138d8-8590-4c1b-a7ad-9d9c8e9e97fe tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:51.668904 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ba6138d8-8590-4c1b-a7ad-9d9c8e9e97fe tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:51.669335 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ba6138d8-8590-4c1b-a7ad-9d9c8e9e97fe tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:51.721976 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-624b9734-8722-4dee-b21a-917f19877368 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:51.730022 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-624b9734-8722-4dee-b21a-917f19877368 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:51.732463 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-624b9734-8722-4dee-b21a-917f19877368 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:51.733700 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-624b9734-8722-4dee-b21a-917f19877368 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.188257 Aug 01 14:22:51.734367 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 152/294] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:51 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:51.835119 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ba6138d8-8590-4c1b-a7ad-9d9c8e9e97fe tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:51.844145 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ba6138d8-8590-4c1b-a7ad-9d9c8e9e97fe tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1723 microversion: 2.1 time: 0.188822 Aug 01 14:22:51.844524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5f29af5f-aeec-4724-824d-58e7be2d29a2 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:51.844712 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 143/295] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:51 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:51.852174 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5f29af5f-aeec-4724-824d-58e7be2d29a2 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:51.852174 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5f29af5f-aeec-4724-824d-58e7be2d29a2 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:51.852174 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5f29af5f-aeec-4724-824d-58e7be2d29a2 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:51.852815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5f29af5f-aeec-4724-824d-58e7be2d29a2 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:51.853328 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5f29af5f-aeec-4724-824d-58e7be2d29a2 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:51.989267 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-5f29af5f-aeec-4724-824d-58e7be2d29a2 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:52.001023 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5f29af5f-aeec-4724-824d-58e7be2d29a2 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1319 microversion: 2.1 time: 0.160247 Aug 01 14:22:52.006069 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 153/296] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:51 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:52.323461 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-60c54fa6-2868-438d-b1a5-d0013d7ef728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:52.324137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-60c54fa6-2868-438d-b1a5-d0013d7ef728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:52.330143 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-60c54fa6-2868-438d-b1a5-d0013d7ef728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:52.330596 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-60c54fa6-2868-438d-b1a5-d0013d7ef728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:52.331360 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-60c54fa6-2868-438d-b1a5-d0013d7ef728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:52.331801 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-60c54fa6-2868-438d-b1a5-d0013d7ef728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:52.514493 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-60c54fa6-2868-438d-b1a5-d0013d7ef728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:52.522254 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-60c54fa6-2868-438d-b1a5-d0013d7ef728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.202430 Aug 01 14:22:52.522820 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 144/297] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:52 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:52.768996 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-931ca4bc-6f4e-4768-bee2-084f94499ffe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:52.769611 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-931ca4bc-6f4e-4768-bee2-084f94499ffe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:52.776145 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-931ca4bc-6f4e-4768-bee2-084f94499ffe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:52.776605 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-931ca4bc-6f4e-4768-bee2-084f94499ffe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:52.781791 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-931ca4bc-6f4e-4768-bee2-084f94499ffe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:52.781791 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-931ca4bc-6f4e-4768-bee2-084f94499ffe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:52.866355 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-dfab6204-89e5-4038-8e17-23fcacceefe9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:52.867196 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-dfab6204-89e5-4038-8e17-23fcacceefe9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:52.875208 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dfab6204-89e5-4038-8e17-23fcacceefe9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:52.875715 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dfab6204-89e5-4038-8e17-23fcacceefe9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:52.876675 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dfab6204-89e5-4038-8e17-23fcacceefe9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:52.877264 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dfab6204-89e5-4038-8e17-23fcacceefe9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:52.945680 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-931ca4bc-6f4e-4768-bee2-084f94499ffe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:52.959664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-931ca4bc-6f4e-4768-bee2-084f94499ffe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:52.962032 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-931ca4bc-6f4e-4768-bee2-084f94499ffe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:52.964295 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-931ca4bc-6f4e-4768-bee2-084f94499ffe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.199274 Aug 01 14:22:52.966089 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 154/298] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:52 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:53.022491 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b81010d4-ed37-4eba-8158-7612c55be898 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:53.023170 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b81010d4-ed37-4eba-8158-7612c55be898 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:53.030531 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b81010d4-ed37-4eba-8158-7612c55be898 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:53.031264 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b81010d4-ed37-4eba-8158-7612c55be898 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:53.032162 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b81010d4-ed37-4eba-8158-7612c55be898 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:53.032714 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b81010d4-ed37-4eba-8158-7612c55be898 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:53.043687 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-dfab6204-89e5-4038-8e17-23fcacceefe9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:53.051796 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-dfab6204-89e5-4038-8e17-23fcacceefe9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1723 microversion: 2.1 time: 0.189414 Aug 01 14:22:53.054659 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 145/299] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:52 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:53.165073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-b81010d4-ed37-4eba-8158-7612c55be898 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:53.173164 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b81010d4-ed37-4eba-8158-7612c55be898 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1319 microversion: 2.1 time: 0.154783 Aug 01 14:22:53.173774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 155/300] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:53 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:53.545255 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-64acbf5f-7769-492a-a702-db86024d9e11 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:53.545864 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-64acbf5f-7769-492a-a702-db86024d9e11 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:53.552133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-64acbf5f-7769-492a-a702-db86024d9e11 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:53.552584 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-64acbf5f-7769-492a-a702-db86024d9e11 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:53.553391 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-64acbf5f-7769-492a-a702-db86024d9e11 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:53.553903 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-64acbf5f-7769-492a-a702-db86024d9e11 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:53.606780 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=2 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:53.646711 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=6 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:53.693435 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-64acbf5f-7769-492a-a702-db86024d9e11 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:53.701520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-64acbf5f-7769-492a-a702-db86024d9e11 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.160930 Aug 01 14:22:53.702115 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 146/301] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:53 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:53.988853 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5c0e18e1-1a4d-4c16-9cc1-089e9c6a378d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:53.989464 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5c0e18e1-1a4d-4c16-9cc1-089e9c6a378d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:53.991910 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=2 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:53.998615 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5c0e18e1-1a4d-4c16-9cc1-089e9c6a378d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:53.999138 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5c0e18e1-1a4d-4c16-9cc1-089e9c6a378d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:53.999973 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5c0e18e1-1a4d-4c16-9cc1-089e9c6a378d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:54.000342 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5c0e18e1-1a4d-4c16-9cc1-089e9c6a378d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:54.072354 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7a2ae93b-7879-448e-8f8e-0495d5bf5723 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:54.072967 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7a2ae93b-7879-448e-8f8e-0495d5bf5723 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:54.079787 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7a2ae93b-7879-448e-8f8e-0495d5bf5723 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:54.080453 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7a2ae93b-7879-448e-8f8e-0495d5bf5723 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:54.083849 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7a2ae93b-7879-448e-8f8e-0495d5bf5723 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:54.083849 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7a2ae93b-7879-448e-8f8e-0495d5bf5723 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:54.201602 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-5c0e18e1-1a4d-4c16-9cc1-089e9c6a378d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:54.211217 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-5c0e18e1-1a4d-4c16-9cc1-089e9c6a378d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:54.212843 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-5c0e18e1-1a4d-4c16-9cc1-089e9c6a378d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:54.214434 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5c0e18e1-1a4d-4c16-9cc1-089e9c6a378d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.229326 Aug 01 14:22:54.217845 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 156/302] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:53 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:54.222801 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-212f3372-da78-4e97-af5a-ff425841b7c6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:54.223632 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-212f3372-da78-4e97-af5a-ff425841b7c6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:54.230085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-212f3372-da78-4e97-af5a-ff425841b7c6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:54.230951 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-212f3372-da78-4e97-af5a-ff425841b7c6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:54.231990 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-212f3372-da78-4e97-af5a-ff425841b7c6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:54.232645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-212f3372-da78-4e97-af5a-ff425841b7c6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:54.259179 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7a2ae93b-7879-448e-8f8e-0495d5bf5723 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:54.271767 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7a2ae93b-7879-448e-8f8e-0495d5bf5723 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1723 microversion: 2.1 time: 0.203075 Aug 01 14:22:54.278912 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 147/303] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:54 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:54.388217 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-212f3372-da78-4e97-af5a-ff425841b7c6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:54.395610 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-212f3372-da78-4e97-af5a-ff425841b7c6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1319 microversion: 2.1 time: 0.176586 Aug 01 14:22:54.396176 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 157/304] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:54 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:54.722863 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1cc4a387-a07a-4287-a539-b56cb9daaf25 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:54.724175 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1cc4a387-a07a-4287-a539-b56cb9daaf25 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:54.730294 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1cc4a387-a07a-4287-a539-b56cb9daaf25 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:54.733483 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1cc4a387-a07a-4287-a539-b56cb9daaf25 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:54.733483 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1cc4a387-a07a-4287-a539-b56cb9daaf25 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:54.733483 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1cc4a387-a07a-4287-a539-b56cb9daaf25 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:54.879137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1cc4a387-a07a-4287-a539-b56cb9daaf25 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:54.887043 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1cc4a387-a07a-4287-a539-b56cb9daaf25 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.168014 Aug 01 14:22:54.887616 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 148/305] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:54 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:55.240503 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-212b2ac5-d22f-44bf-9d1d-708d12aab6ed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:55.241152 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-212b2ac5-d22f-44bf-9d1d-708d12aab6ed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:55.248262 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-212b2ac5-d22f-44bf-9d1d-708d12aab6ed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.248722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-212b2ac5-d22f-44bf-9d1d-708d12aab6ed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.249484 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-212b2ac5-d22f-44bf-9d1d-708d12aab6ed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.249961 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-212b2ac5-d22f-44bf-9d1d-708d12aab6ed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.298662 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-47068f51-059c-4f38-b93e-7587534436f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:55.299276 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-47068f51-059c-4f38-b93e-7587534436f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:55.305197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-47068f51-059c-4f38-b93e-7587534436f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.305642 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-47068f51-059c-4f38-b93e-7587534436f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.306430 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-47068f51-059c-4f38-b93e-7587534436f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.306863 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-47068f51-059c-4f38-b93e-7587534436f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.456396 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-212b2ac5-d22f-44bf-9d1d-708d12aab6ed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:55.464551 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-212b2ac5-d22f-44bf-9d1d-708d12aab6ed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:55.466224 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-212b2ac5-d22f-44bf-9d1d-708d12aab6ed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:55.467393 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-212b2ac5-d22f-44bf-9d1d-708d12aab6ed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.230910 Aug 01 14:22:55.468488 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 158/306] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:55 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:55.473419 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b7595e18-5a3b-4d6b-b800-a418ffaa1d66 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:55.474270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b7595e18-5a3b-4d6b-b800-a418ffaa1d66 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:55.483004 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b7595e18-5a3b-4d6b-b800-a418ffaa1d66 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.483714 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b7595e18-5a3b-4d6b-b800-a418ffaa1d66 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.484878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b7595e18-5a3b-4d6b-b800-a418ffaa1d66 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.486729 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b7595e18-5a3b-4d6b-b800-a418ffaa1d66 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.487261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-47068f51-059c-4f38-b93e-7587534436f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:55.499367 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-47068f51-059c-4f38-b93e-7587534436f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1723 microversion: 2.1 time: 0.204520 Aug 01 14:22:55.500296 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 149/307] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:55 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:55.633132 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-b7595e18-5a3b-4d6b-b800-a418ffaa1d66 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:55.640899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b7595e18-5a3b-4d6b-b800-a418ffaa1d66 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1319 microversion: 2.1 time: 0.171167 Aug 01 14:22:55.641476 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 159/308] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:55 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:55.908767 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-78250a08-8c40-46df-b31d-bf421b3321fc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:55.909469 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-78250a08-8c40-46df-b31d-bf421b3321fc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:55.915597 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-78250a08-8c40-46df-b31d-bf421b3321fc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.916126 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-78250a08-8c40-46df-b31d-bf421b3321fc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.916901 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-78250a08-8c40-46df-b31d-bf421b3321fc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.917343 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-78250a08-8c40-46df-b31d-bf421b3321fc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.048427 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-78250a08-8c40-46df-b31d-bf421b3321fc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:56.055895 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-78250a08-8c40-46df-b31d-bf421b3321fc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1501 microversion: 2.1 time: 0.151000 Aug 01 14:22:56.056601 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 150/309] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:55 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1501 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:56.076389 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d9faf984-a22e-4abe-b076-578226689034 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae4db618-8a70-4c08-9e2e-a48b23a548ee"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:56.078946 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d9faf984-a22e-4abe-b076-578226689034 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:56.088061 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d9faf984-a22e-4abe-b076-578226689034 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.088061 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d9faf984-a22e-4abe-b076-578226689034 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.088061 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d9faf984-a22e-4abe-b076-578226689034 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.088061 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d9faf984-a22e-4abe-b076-578226689034 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.092247 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=100 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:56.116769 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-d9faf984-a22e-4abe-b076-578226689034 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] HTTP exception thrown: Cannot 'attach_volume' instance c3824777-d8b1-4993-a19d-921e3054fde8 while it is in vm_state rescued Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d9faf984-a22e-4abe-b076-578226689034 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Request method failure captured: Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: POST /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8/os-volume_attachments HTTP/1.1 Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 74 Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-E4_d12P1yLmeAi6iRzWLrJoqCmtM2x-aOg__n743TyqbmpKOWkckS8c7k87mJ7g9R1SSYLqx8F7V6s4r-ccgea6VgW8gApwCdGP9EruZPZ0fjTAqXY6MSyeImK19uptwGcDBuAzC8kp39QF0SDqE5zKBuWPoWoccfhbA-KPOePrK4 Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: c80bd4eb290541d8a713ea5ba60d0de4 Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1518303562 Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:22:56.118774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:22:56.120062 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:22:56.120062 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1518303562 Aug 01 14:22:56.120062 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: c80bd4eb290541d8a713ea5ba60d0de4 Aug 01 14:22:56.120062 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1518303562 Aug 01 14:22:56.120062 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-ServerRescueNegativeTestJSON-1518303562-project Aug 01 14:22:56.120062 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:22:56.120062 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:22:56.120062 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: 6b46ac5a29594c41a83e70838b0a13c8 Aug 01 14:22:56.120062 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1518303562-project Aug 01 14:22:56.120062 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Aug 01 14:22:56.120062 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {"volumeAttachment": {"volumeId": "ae4db618-8a70-4c08-9e2e-a48b23a548ee"}} Aug 01 14:22:56.120062 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Cannot 'attach_volume' instance c3824777-d8b1-4993-a19d-921e3054fde8 while it is in vm_state rescued Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'server_id': 'c3824777-d8b1-4993-a19d-921e3054fde8', 'body': {'volumeAttachment': {'volumeId': 'ae4db618-8a70-4c08-9e2e-a48b23a548ee'}}} Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c3824777-d8b1-4993-a19d-921e3054fde8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:22:56.120797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c3824777-d8b1-4993-a19d-921e3054fde8 while it is in vm_state rescued Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:56.122307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:56.123717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:22:56.123717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:22:56.123717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c3824777-d8b1-4993-a19d-921e3054fde8 while it is in vm_state rescued Aug 01 14:22:56.123717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:22:56.123717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d9faf984-a22e-4abe-b076-578226689034 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Returning 409 to user: Cannot 'attach_volume' instance c3824777-d8b1-4993-a19d-921e3054fde8 while it is in vm_state rescued {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:22:56.123717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d9faf984-a22e-4abe-b076-578226689034 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "POST /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048425 Aug 01 14:22:56.123717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 160/310] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Aug 1 14:22:56 2022] POST /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 14:22:56.132712 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-83add793-7101-4131-8a35-2eefef7d5ff4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:56.133161 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-83add793-7101-4131-8a35-2eefef7d5ff4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:56.140279 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-83add793-7101-4131-8a35-2eefef7d5ff4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.140858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-83add793-7101-4131-8a35-2eefef7d5ff4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.141508 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-83add793-7101-4131-8a35-2eefef7d5ff4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.141972 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-83add793-7101-4131-8a35-2eefef7d5ff4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.418313 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-83add793-7101-4131-8a35-2eefef7d5ff4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "POST /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8/action" status: 202 len: 0 microversion: 2.1 time: 0.291235 Aug 01 14:22:56.419474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 151/311] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Aug 1 14:22:56 2022] POST /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:22:56.428990 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-eb0cea91-3312-44f9-bfb9-318a1f5d5ec6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:56.429619 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-eb0cea91-3312-44f9-bfb9-318a1f5d5ec6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:56.442165 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-eb0cea91-3312-44f9-bfb9-318a1f5d5ec6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.442636 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-eb0cea91-3312-44f9-bfb9-318a1f5d5ec6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.445736 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-eb0cea91-3312-44f9-bfb9-318a1f5d5ec6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.446238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-eb0cea91-3312-44f9-bfb9-318a1f5d5ec6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.446361 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-c5dcb8c2-65ad-42ef-b66c-e035cc4ac855 req-bf1a109d-fe49-47c0-a9b6-94b01e952a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b499d85-fa7b-4fa0-b970-87213e327ef5", "name": "network-vif-plugged", "status": "completed", "tag": "545f2703-552c-4f53-95c9-72930069a993"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:56.460397 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-c5dcb8c2-65ad-42ef-b66c-e035cc4ac855 req-bf1a109d-fe49-47c0-a9b6-94b01e952a27 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.461132 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-c5dcb8c2-65ad-42ef-b66c-e035cc4ac855 req-bf1a109d-fe49-47c0-a9b6-94b01e952a27 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.477271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-c5dcb8c2-65ad-42ef-b66c-e035cc4ac855 req-bf1a109d-fe49-47c0-a9b6-94b01e952a27 service nova] Creating event network-vif-plugged:545f2703-552c-4f53-95c9-72930069a993 for instance 6b499d85-fa7b-4fa0-b970-87213e327ef5 on hv-cinder-78729 Aug 01 14:22:56.483322 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-c5dcb8c2-65ad-42ef-b66c-e035cc4ac855 req-bf1a109d-fe49-47c0-a9b6-94b01e952a27 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045271 Aug 01 14:22:56.484827 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 152/312] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:22:56.492372 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-408b4167-46e4-40a5-b6e4-941fd186f304 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:56.493095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-408b4167-46e4-40a5-b6e4-941fd186f304 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:56.502639 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-408b4167-46e4-40a5-b6e4-941fd186f304 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.503097 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-408b4167-46e4-40a5-b6e4-941fd186f304 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.503882 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-408b4167-46e4-40a5-b6e4-941fd186f304 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.504319 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-408b4167-46e4-40a5-b6e4-941fd186f304 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.676096 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-eb0cea91-3312-44f9-bfb9-318a1f5d5ec6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:56.693337 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-eb0cea91-3312-44f9-bfb9-318a1f5d5ec6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1509 microversion: 2.1 time: 0.269752 Aug 01 14:22:56.702120 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 161/313] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:56 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1509 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:56.708421 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c1b9942e-9350-4bd5-9680-da53adf0f8f1 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:56.709328 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c1b9942e-9350-4bd5-9680-da53adf0f8f1 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:56.718169 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c1b9942e-9350-4bd5-9680-da53adf0f8f1 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.718633 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c1b9942e-9350-4bd5-9680-da53adf0f8f1 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.719417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c1b9942e-9350-4bd5-9680-da53adf0f8f1 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.719898 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c1b9942e-9350-4bd5-9680-da53adf0f8f1 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.746528 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-408b4167-46e4-40a5-b6e4-941fd186f304 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:56.756038 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-408b4167-46e4-40a5-b6e4-941fd186f304 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:56.758388 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-408b4167-46e4-40a5-b6e4-941fd186f304 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:56.759896 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-408b4167-46e4-40a5-b6e4-941fd186f304 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.271722 Aug 01 14:22:56.760598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 153/314] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:56 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:22:56.766802 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-441c845b-9164-4b20-aa5e-c6fd75ff7a7d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:56.767757 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-441c845b-9164-4b20-aa5e-c6fd75ff7a7d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:56.775813 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-441c845b-9164-4b20-aa5e-c6fd75ff7a7d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.777143 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-441c845b-9164-4b20-aa5e-c6fd75ff7a7d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.778702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-441c845b-9164-4b20-aa5e-c6fd75ff7a7d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.779672 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-441c845b-9164-4b20-aa5e-c6fd75ff7a7d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:57.029434 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c1b9942e-9350-4bd5-9680-da53adf0f8f1 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:57.037733 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c1b9942e-9350-4bd5-9680-da53adf0f8f1 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1723 microversion: 2.1 time: 0.334010 Aug 01 14:22:57.041271 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 162/315] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:56 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:57.051179 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-441c845b-9164-4b20-aa5e-c6fd75ff7a7d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:57.074343 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-441c845b-9164-4b20-aa5e-c6fd75ff7a7d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1319 microversion: 2.1 time: 0.299756 Aug 01 14:22:57.074343 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 154/316] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:56 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:57.717205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d3dff727-3801-4c7d-80d8-c4e927917ce8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:57.717957 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d3dff727-3801-4c7d-80d8-c4e927917ce8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:57.725481 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d3dff727-3801-4c7d-80d8-c4e927917ce8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:57.725967 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d3dff727-3801-4c7d-80d8-c4e927917ce8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:57.726744 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d3dff727-3801-4c7d-80d8-c4e927917ce8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:57.727187 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d3dff727-3801-4c7d-80d8-c4e927917ce8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:57.788369 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c3d3c107-dfc1-4e94-a0a8-1e2eab89efa6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:57.789089 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c3d3c107-dfc1-4e94-a0a8-1e2eab89efa6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:57.795773 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c3d3c107-dfc1-4e94-a0a8-1e2eab89efa6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:57.796232 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c3d3c107-dfc1-4e94-a0a8-1e2eab89efa6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:57.797063 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c3d3c107-dfc1-4e94-a0a8-1e2eab89efa6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:57.797508 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c3d3c107-dfc1-4e94-a0a8-1e2eab89efa6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:57.801675 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:57.900811 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d3dff727-3801-4c7d-80d8-c4e927917ce8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:57.910329 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d3dff727-3801-4c7d-80d8-c4e927917ce8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1509 microversion: 2.1 time: 0.197228 Aug 01 14:22:57.911345 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 163/317] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:57 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:57.952211 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c3d3c107-dfc1-4e94-a0a8-1e2eab89efa6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:57.961347 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c3d3c107-dfc1-4e94-a0a8-1e2eab89efa6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:57.962156 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c3d3c107-dfc1-4e94-a0a8-1e2eab89efa6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:57.963301 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c3d3c107-dfc1-4e94-a0a8-1e2eab89efa6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.178870 Aug 01 14:22:57.963853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 155/318] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:57 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:58.061352 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-289f0bd5-43e8-42f5-9432-b3cfd68e7a90 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:58.068609 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-289f0bd5-43e8-42f5-9432-b3cfd68e7a90 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:58.070920 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-289f0bd5-43e8-42f5-9432-b3cfd68e7a90 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.070920 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-289f0bd5-43e8-42f5-9432-b3cfd68e7a90 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.071441 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-289f0bd5-43e8-42f5-9432-b3cfd68e7a90 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.072037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-289f0bd5-43e8-42f5-9432-b3cfd68e7a90 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.087379 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-22efa0de-8a33-4c84-9dee-132b8a0ec8d9 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:58.088007 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-22efa0de-8a33-4c84-9dee-132b8a0ec8d9 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:58.096311 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-22efa0de-8a33-4c84-9dee-132b8a0ec8d9 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.096767 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-22efa0de-8a33-4c84-9dee-132b8a0ec8d9 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.099299 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-22efa0de-8a33-4c84-9dee-132b8a0ec8d9 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.099299 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-22efa0de-8a33-4c84-9dee-132b8a0ec8d9 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.326907 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-289f0bd5-43e8-42f5-9432-b3cfd68e7a90 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:58.334687 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-22efa0de-8a33-4c84-9dee-132b8a0ec8d9 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:58.335833 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-289f0bd5-43e8-42f5-9432-b3cfd68e7a90 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1723 microversion: 2.1 time: 0.279901 Aug 01 14:22:58.336411 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 164/319] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:58 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:58.344967 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-22efa0de-8a33-4c84-9dee-132b8a0ec8d9 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1319 microversion: 2.1 time: 0.262920 Aug 01 14:22:58.345529 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 156/320] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:58 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:58.932556 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-27f7e2e1-c83c-43a2-a83f-85c4f7cae60b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:58.933211 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-27f7e2e1-c83c-43a2-a83f-85c4f7cae60b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:58.940307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-27f7e2e1-c83c-43a2-a83f-85c4f7cae60b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.940772 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-27f7e2e1-c83c-43a2-a83f-85c4f7cae60b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.941566 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-27f7e2e1-c83c-43a2-a83f-85c4f7cae60b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.942037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-27f7e2e1-c83c-43a2-a83f-85c4f7cae60b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.987383 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1f4c9945-3e70-40ab-9d9f-cca33f0be207 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:58.988106 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1f4c9945-3e70-40ab-9d9f-cca33f0be207 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:58.994442 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1f4c9945-3e70-40ab-9d9f-cca33f0be207 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.994891 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1f4c9945-3e70-40ab-9d9f-cca33f0be207 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.995656 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1f4c9945-3e70-40ab-9d9f-cca33f0be207 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.996095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1f4c9945-3e70-40ab-9d9f-cca33f0be207 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:59.117778 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-27f7e2e1-c83c-43a2-a83f-85c4f7cae60b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:59.125682 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-27f7e2e1-c83c-43a2-a83f-85c4f7cae60b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1509 microversion: 2.1 time: 0.197747 Aug 01 14:22:59.126360 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 165/321] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:58 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:59.152972 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1f4c9945-3e70-40ab-9d9f-cca33f0be207 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:59.161804 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1f4c9945-3e70-40ab-9d9f-cca33f0be207 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:59.163313 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1f4c9945-3e70-40ab-9d9f-cca33f0be207 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:59.164465 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1f4c9945-3e70-40ab-9d9f-cca33f0be207 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1745 microversion: 2.20 time: 0.181136 Aug 01 14:22:59.167807 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 157/322] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:22:58 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:22:59.362304 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-cf47d48f-af89-4d78-abd0-d8bef58470b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:59.363032 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-cf47d48f-af89-4d78-abd0-d8bef58470b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:59.367579 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a8ef426d-0135-4d35-8358-9cc3e5837ebc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:59.368160 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a8ef426d-0135-4d35-8358-9cc3e5837ebc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:59.369929 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cf47d48f-af89-4d78-abd0-d8bef58470b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:59.370382 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cf47d48f-af89-4d78-abd0-d8bef58470b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:59.371143 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cf47d48f-af89-4d78-abd0-d8bef58470b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:59.371737 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cf47d48f-af89-4d78-abd0-d8bef58470b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:59.374595 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a8ef426d-0135-4d35-8358-9cc3e5837ebc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:59.375044 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a8ef426d-0135-4d35-8358-9cc3e5837ebc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:59.375801 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a8ef426d-0135-4d35-8358-9cc3e5837ebc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:59.376221 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a8ef426d-0135-4d35-8358-9cc3e5837ebc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:59.523081 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-cf47d48f-af89-4d78-abd0-d8bef58470b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:59.531564 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-cf47d48f-af89-4d78-abd0-d8bef58470b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1723 microversion: 2.1 time: 0.173135 Aug 01 14:22:59.532139 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 166/323] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:59 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:59.656447 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a8ef426d-0135-4d35-8358-9cc3e5837ebc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:59.672084 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a8ef426d-0135-4d35-8358-9cc3e5837ebc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1319 microversion: 2.1 time: 0.304848 Aug 01 14:22:59.672084 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 158/324] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:59 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:00.147954 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-a29e31fb-b158-4527-9282-ff0e350aa111 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:00.148642 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-a29e31fb-b158-4527-9282-ff0e350aa111 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:00.165594 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a29e31fb-b158-4527-9282-ff0e350aa111 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.165987 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a29e31fb-b158-4527-9282-ff0e350aa111 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.166773 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a29e31fb-b158-4527-9282-ff0e350aa111 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.167204 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a29e31fb-b158-4527-9282-ff0e350aa111 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.188997 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b5945039-8da8-492f-b4be-25afb3334f80 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:00.190278 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b5945039-8da8-492f-b4be-25afb3334f80 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:00.196405 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b5945039-8da8-492f-b4be-25afb3334f80 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.196932 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b5945039-8da8-492f-b4be-25afb3334f80 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.197794 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b5945039-8da8-492f-b4be-25afb3334f80 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.198301 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b5945039-8da8-492f-b4be-25afb3334f80 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.460783 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a29e31fb-b158-4527-9282-ff0e350aa111 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:00.472660 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-a29e31fb-b158-4527-9282-ff0e350aa111 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1509 microversion: 2.1 time: 0.328395 Aug 01 14:23:00.474254 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 167/325] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:00 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1509 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:00.500985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b5945039-8da8-492f-b4be-25afb3334f80 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:00.509697 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b5945039-8da8-492f-b4be-25afb3334f80 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:00.511467 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b5945039-8da8-492f-b4be-25afb3334f80 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:00.512633 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b5945039-8da8-492f-b4be-25afb3334f80 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1745 microversion: 2.20 time: 0.328533 Aug 01 14:23:00.513257 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 159/326] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:00 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1745 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:00.552446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-2cbf1d9a-0a2e-40e7-81cc-8fa7b2a55866 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:00.553063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-2cbf1d9a-0a2e-40e7-81cc-8fa7b2a55866 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:00.559201 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2cbf1d9a-0a2e-40e7-81cc-8fa7b2a55866 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.559656 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2cbf1d9a-0a2e-40e7-81cc-8fa7b2a55866 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.560820 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2cbf1d9a-0a2e-40e7-81cc-8fa7b2a55866 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.561265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2cbf1d9a-0a2e-40e7-81cc-8fa7b2a55866 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.691493 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a3b960f7-0dae-4ba0-80f1-d4c336bed7e1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:00.692209 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a3b960f7-0dae-4ba0-80f1-d4c336bed7e1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:00.692892 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2cbf1d9a-0a2e-40e7-81cc-8fa7b2a55866 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:00.698657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3b960f7-0dae-4ba0-80f1-d4c336bed7e1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.699108 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3b960f7-0dae-4ba0-80f1-d4c336bed7e1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.699880 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3b960f7-0dae-4ba0-80f1-d4c336bed7e1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.700311 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3b960f7-0dae-4ba0-80f1-d4c336bed7e1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.701624 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-2cbf1d9a-0a2e-40e7-81cc-8fa7b2a55866 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1723 microversion: 2.1 time: 0.152886 Aug 01 14:23:00.702250 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 168/327] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:00 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:00.837701 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a3b960f7-0dae-4ba0-80f1-d4c336bed7e1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:00.845744 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a3b960f7-0dae-4ba0-80f1-d4c336bed7e1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1319 microversion: 2.1 time: 0.158189 Aug 01 14:23:00.846315 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 160/328] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:00 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:01.495850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ea5ab6ea-5bd6-4132-bc16-6b795e950744 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:01.496531 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ea5ab6ea-5bd6-4132-bc16-6b795e950744 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:01.504922 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ea5ab6ea-5bd6-4132-bc16-6b795e950744 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.505370 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ea5ab6ea-5bd6-4132-bc16-6b795e950744 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.506183 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ea5ab6ea-5bd6-4132-bc16-6b795e950744 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.508759 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ea5ab6ea-5bd6-4132-bc16-6b795e950744 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.536982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-db153c76-671e-4513-b21b-6da470777e8d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:01.537856 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-db153c76-671e-4513-b21b-6da470777e8d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:01.539843 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:01.545460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-db153c76-671e-4513-b21b-6da470777e8d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.545974 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-db153c76-671e-4513-b21b-6da470777e8d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.546774 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-db153c76-671e-4513-b21b-6da470777e8d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.547216 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-db153c76-671e-4513-b21b-6da470777e8d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.756231 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ea5ab6ea-5bd6-4132-bc16-6b795e950744 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:01.766256 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ea5ab6ea-5bd6-4132-bc16-6b795e950744 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1515 microversion: 2.1 time: 0.274113 Aug 01 14:23:01.767623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 169/329] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:01 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1515 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:01.777667 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-2b130278-5a9c-4748-9fe6-cf2e7a0d0ac4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:01.777667 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-2b130278-5a9c-4748-9fe6-cf2e7a0d0ac4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:01.783107 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2b130278-5a9c-4748-9fe6-cf2e7a0d0ac4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.783863 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2b130278-5a9c-4748-9fe6-cf2e7a0d0ac4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.784844 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2b130278-5a9c-4748-9fe6-cf2e7a0d0ac4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.785454 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2b130278-5a9c-4748-9fe6-cf2e7a0d0ac4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.803976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-db153c76-671e-4513-b21b-6da470777e8d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:01.815924 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-db153c76-671e-4513-b21b-6da470777e8d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:01.818892 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-db153c76-671e-4513-b21b-6da470777e8d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:01.820546 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-db153c76-671e-4513-b21b-6da470777e8d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1745 microversion: 2.20 time: 0.287336 Aug 01 14:23:01.829726 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 161/330] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:01 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1745 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:01.870418 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-9a7b80ff-6cfa-42ff-b0f0-9dc8af03b263 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:01.871471 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-9a7b80ff-6cfa-42ff-b0f0-9dc8af03b263 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:01.881833 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9a7b80ff-6cfa-42ff-b0f0-9dc8af03b263 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.882571 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9a7b80ff-6cfa-42ff-b0f0-9dc8af03b263 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.883982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9a7b80ff-6cfa-42ff-b0f0-9dc8af03b263 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.884675 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9a7b80ff-6cfa-42ff-b0f0-9dc8af03b263 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:02.045632 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2b130278-5a9c-4748-9fe6-cf2e7a0d0ac4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:02.058454 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-2b130278-5a9c-4748-9fe6-cf2e7a0d0ac4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1723 microversion: 2.1 time: 0.287160 Aug 01 14:23:02.059404 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 170/331] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:01 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:02.101007 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-9a7b80ff-6cfa-42ff-b0f0-9dc8af03b263 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:02.111783 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-9a7b80ff-6cfa-42ff-b0f0-9dc8af03b263 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1508 microversion: 2.1 time: 0.247376 Aug 01 14:23:02.113168 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 162/332] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:01 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1508 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:02.846576 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-aff0c533-2645-4076-8302-39a5c82d8cfe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:02.847166 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-aff0c533-2645-4076-8302-39a5c82d8cfe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:02.853848 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-aff0c533-2645-4076-8302-39a5c82d8cfe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:02.854234 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-aff0c533-2645-4076-8302-39a5c82d8cfe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:02.855002 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-aff0c533-2645-4076-8302-39a5c82d8cfe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:02.855433 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-aff0c533-2645-4076-8302-39a5c82d8cfe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:03.008769 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-aff0c533-2645-4076-8302-39a5c82d8cfe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:03.019534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-aff0c533-2645-4076-8302-39a5c82d8cfe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:03.021303 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-aff0c533-2645-4076-8302-39a5c82d8cfe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:03.022681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-aff0c533-2645-4076-8302-39a5c82d8cfe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1745 microversion: 2.20 time: 0.180005 Aug 01 14:23:03.023424 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 171/333] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:02 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:03.088304 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-48d4f206-0728-44bb-8847-a8c7b69df7de tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:03.088925 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-48d4f206-0728-44bb-8847-a8c7b69df7de tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:03.096862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-48d4f206-0728-44bb-8847-a8c7b69df7de tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:03.097318 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-48d4f206-0728-44bb-8847-a8c7b69df7de tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:03.098126 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-48d4f206-0728-44bb-8847-a8c7b69df7de tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:03.098571 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-48d4f206-0728-44bb-8847-a8c7b69df7de tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:03.231107 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-48d4f206-0728-44bb-8847-a8c7b69df7de tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:03.239310 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-48d4f206-0728-44bb-8847-a8c7b69df7de tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1723 microversion: 2.1 time: 0.154902 Aug 01 14:23:03.239869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 163/334] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:03 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:03.624299 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-f5955263-1c8c-4964-a12d-e9ecb6045606 req-a8a2faa0-024b-49f2-a0e4-8531fa2cc54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c41c564-40f2-47cf-820b-915c3d43ccb3", "name": "network-vif-plugged", "status": "completed", "tag": "bc816aff-9768-4c40-a6d1-adb40e9ce6a1"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:03.633772 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-f5955263-1c8c-4964-a12d-e9ecb6045606 req-a8a2faa0-024b-49f2-a0e4-8531fa2cc54a service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:03.639860 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-f5955263-1c8c-4964-a12d-e9ecb6045606 req-a8a2faa0-024b-49f2-a0e4-8531fa2cc54a service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:03.647417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-f5955263-1c8c-4964-a12d-e9ecb6045606 req-a8a2faa0-024b-49f2-a0e4-8531fa2cc54a service nova] Creating event network-vif-plugged:bc816aff-9768-4c40-a6d1-adb40e9ce6a1 for instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 on hv-cinder-78729 Aug 01 14:23:03.652463 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-f5955263-1c8c-4964-a12d-e9ecb6045606 req-a8a2faa0-024b-49f2-a0e4-8531fa2cc54a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032550 Aug 01 14:23:03.653043 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 172/335] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:23:04.048759 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1d25f011-89a8-4aeb-8d9b-dc1740ab32ba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:04.049556 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1d25f011-89a8-4aeb-8d9b-dc1740ab32ba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:04.057603 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1d25f011-89a8-4aeb-8d9b-dc1740ab32ba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:04.058087 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1d25f011-89a8-4aeb-8d9b-dc1740ab32ba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:04.059179 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1d25f011-89a8-4aeb-8d9b-dc1740ab32ba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:04.059790 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1d25f011-89a8-4aeb-8d9b-dc1740ab32ba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:04.191815 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1d25f011-89a8-4aeb-8d9b-dc1740ab32ba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:04.199765 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1d25f011-89a8-4aeb-8d9b-dc1740ab32ba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:04.201538 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1d25f011-89a8-4aeb-8d9b-dc1740ab32ba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:04.202721 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1d25f011-89a8-4aeb-8d9b-dc1740ab32ba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1745 microversion: 2.20 time: 0.158716 Aug 01 14:23:04.203279 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 164/336] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:04 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:04.261378 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8044c0c6-f3aa-45a2-9073-e90187eff7e0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:04.262135 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8044c0c6-f3aa-45a2-9073-e90187eff7e0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:04.268704 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8044c0c6-f3aa-45a2-9073-e90187eff7e0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:04.269150 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8044c0c6-f3aa-45a2-9073-e90187eff7e0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:04.269964 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8044c0c6-f3aa-45a2-9073-e90187eff7e0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:04.270404 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8044c0c6-f3aa-45a2-9073-e90187eff7e0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:04.406342 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8044c0c6-f3aa-45a2-9073-e90187eff7e0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:04.414451 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8044c0c6-f3aa-45a2-9073-e90187eff7e0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1723 microversion: 2.1 time: 0.157786 Aug 01 14:23:04.415018 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 173/337] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:04 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:05.226164 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e6a9ff20-ccee-4464-bdc6-b37574e584c4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:05.226779 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e6a9ff20-ccee-4464-bdc6-b37574e584c4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:05.233326 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e6a9ff20-ccee-4464-bdc6-b37574e584c4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:05.233804 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e6a9ff20-ccee-4464-bdc6-b37574e584c4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:05.234588 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e6a9ff20-ccee-4464-bdc6-b37574e584c4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:05.235030 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e6a9ff20-ccee-4464-bdc6-b37574e584c4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:05.368786 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e6a9ff20-ccee-4464-bdc6-b37574e584c4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:05.377505 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e6a9ff20-ccee-4464-bdc6-b37574e584c4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:05.379049 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e6a9ff20-ccee-4464-bdc6-b37574e584c4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:05.380200 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e6a9ff20-ccee-4464-bdc6-b37574e584c4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1745 microversion: 2.20 time: 0.157866 Aug 01 14:23:05.380748 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 165/338] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:05 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:05.435667 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f08e85ed-fcbd-4db3-bd01-bf7a37966df0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:05.437379 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f08e85ed-fcbd-4db3-bd01-bf7a37966df0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:05.440088 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=94 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:05.445235 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f08e85ed-fcbd-4db3-bd01-bf7a37966df0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:05.451623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f08e85ed-fcbd-4db3-bd01-bf7a37966df0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:05.451623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f08e85ed-fcbd-4db3-bd01-bf7a37966df0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:05.451623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f08e85ed-fcbd-4db3-bd01-bf7a37966df0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:05.586235 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f08e85ed-fcbd-4db3-bd01-bf7a37966df0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:05.595822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f08e85ed-fcbd-4db3-bd01-bf7a37966df0 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1723 microversion: 2.1 time: 0.163716 Aug 01 14:23:05.596901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 174/339] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:05 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:06.049882 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-173d8762-3e14-4bae-84f5-3f410b60d0b6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Action: 'create', calling method: .version_select at 0x7fb254292790>, body: {"keypair": {"name": "tempest-keypair-928547737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaWMYwCF/FICjEWU0fMDxnJjj9LfXsUNFcZp1qPi/9VOOVDiC2wx5QR3zsf4qRmfkpu+JIfr1imosUk9fbiHn57wDNQ9wZBJLPTKI4fMCv8jHomC65MCGUajlgYtfCdIQ=="}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:06.069954 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-173d8762-3e14-4bae-84f5-3f410b60d0b6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Getting quotas for project c80bd4eb290541d8a713ea5ba60d0de4. Resources: {'key_pairs'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:23:06.074079 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-173d8762-3e14-4bae-84f5-3f410b60d0b6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Getting quotas for user 6b46ac5a29594c41a83e70838b0a13c8 and project c80bd4eb290541d8a713ea5ba60d0de4. Resources: {'key_pairs'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:23:06.181658 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-173d8762-3e14-4bae-84f5-3f410b60d0b6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135301 Aug 01 14:23:06.182427 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 166/340] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Aug 1 14:23:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:23:06.292675 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0b338b44-f24e-4fdb-ac4d-51774220d85f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1725350433", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:06.403172 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-2ba59493-af96-4a29-85db-4e2b935bd41b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:06.403887 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-2ba59493-af96-4a29-85db-4e2b935bd41b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:06.410997 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2ba59493-af96-4a29-85db-4e2b935bd41b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:06.411444 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2ba59493-af96-4a29-85db-4e2b935bd41b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:06.412200 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2ba59493-af96-4a29-85db-4e2b935bd41b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:06.412635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2ba59493-af96-4a29-85db-4e2b935bd41b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:06.581478 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2ba59493-af96-4a29-85db-4e2b935bd41b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:06.589548 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2ba59493-af96-4a29-85db-4e2b935bd41b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:06.591252 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2ba59493-af96-4a29-85db-4e2b935bd41b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:06.593134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-2ba59493-af96-4a29-85db-4e2b935bd41b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1745 microversion: 2.20 time: 0.193459 Aug 01 14:23:06.593945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 167/341] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:06 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1745 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:06.619176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a98ad0f7-4356-412a-a873-721333a618b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:06.619775 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a98ad0f7-4356-412a-a873-721333a618b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:06.626485 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a98ad0f7-4356-412a-a873-721333a618b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:06.626987 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a98ad0f7-4356-412a-a873-721333a618b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:06.627756 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a98ad0f7-4356-412a-a873-721333a618b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:06.628199 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a98ad0f7-4356-412a-a873-721333a618b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:06.779821 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a98ad0f7-4356-412a-a873-721333a618b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:06.788920 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a98ad0f7-4356-412a-a873-721333a618b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1723 microversion: 2.1 time: 0.173746 Aug 01 14:23:06.789736 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 168/342] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:06 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:07.620711 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-003cc344-5cca-442a-bca2-21e33484d036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:07.621401 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-003cc344-5cca-442a-bca2-21e33484d036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:07.628337 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-003cc344-5cca-442a-bca2-21e33484d036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:07.628787 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-003cc344-5cca-442a-bca2-21e33484d036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:07.629561 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-003cc344-5cca-442a-bca2-21e33484d036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:07.630027 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-003cc344-5cca-442a-bca2-21e33484d036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:07.812104 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-003cc344-5cca-442a-bca2-21e33484d036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:07.821781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-003cc344-5cca-442a-bca2-21e33484d036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:07.823316 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-003cc344-5cca-442a-bca2-21e33484d036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:07.824509 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-003cc344-5cca-442a-bca2-21e33484d036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1740 microversion: 2.20 time: 0.208250 Aug 01 14:23:07.825164 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 169/343] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:07 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:07.829860 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-92f5049d-43b8-459e-ad88-4c1b41f85f9a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:07.830469 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-92f5049d-43b8-459e-ad88-4c1b41f85f9a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:07.836913 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-92f5049d-43b8-459e-ad88-4c1b41f85f9a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:07.837294 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-92f5049d-43b8-459e-ad88-4c1b41f85f9a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:07.839312 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-92f5049d-43b8-459e-ad88-4c1b41f85f9a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:07.839886 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-92f5049d-43b8-459e-ad88-4c1b41f85f9a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:08.074808 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-92f5049d-43b8-459e-ad88-4c1b41f85f9a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:08.083475 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-92f5049d-43b8-459e-ad88-4c1b41f85f9a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1723 microversion: 2.1 time: 0.257043 Aug 01 14:23:08.084052 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 170/344] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:07 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:08.851621 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-48b48d23-e631-4165-a871-a8565be103fc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:08.853359 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-48b48d23-e631-4165-a871-a8565be103fc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:08.860387 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-48b48d23-e631-4165-a871-a8565be103fc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:08.861209 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-48b48d23-e631-4165-a871-a8565be103fc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:08.862050 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-48b48d23-e631-4165-a871-a8565be103fc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:08.862786 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-48b48d23-e631-4165-a871-a8565be103fc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:09.030402 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-48b48d23-e631-4165-a871-a8565be103fc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:09.040225 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-48b48d23-e631-4165-a871-a8565be103fc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:09.041728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-48b48d23-e631-4165-a871-a8565be103fc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:09.042922 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-48b48d23-e631-4165-a871-a8565be103fc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1740 microversion: 2.20 time: 0.196203 Aug 01 14:23:09.049815 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 171/345] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:08 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:09.049998 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3c91ec2d-3870-4124-910b-aad6ffdaa765 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-802460979", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf6cca88-8a12-4d78-b962-67bd78f418e2"}], "security_groups": [{"name": "tempest-securitygroup--1015097769"}], "key_name": "tempest-keypair-928547737", "user_data": "}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:15.590537 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=82 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:16.082582 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=4 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:16.296119 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=3 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:19.034761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=95 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:19.060094 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:21.450683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.network.neutron [None req-0b338b44-f24e-4fdb-ac4d-51774220d85f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] validate_networks() for None {{(pid=118246) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:23:21.634744 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.network.neutron [None req-3c91ec2d-3870-4124-910b-aad6ffdaa765 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] validate_networks() for [('bf6cca88-8a12-4d78-b962-67bd78f418e2', None, None, None, None, None)] {{(pid=118247) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:23:21.884521 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-0b338b44-f24e-4fdb-ac4d-51774220d85f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Flavor limits 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:23:21.888277 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-0b338b44-f24e-4fdb-ac4d-51774220d85f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Image limits 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:23:21.888884 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-0b338b44-f24e-4fdb-ac4d-51774220d85f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Flavor pref 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:23:21.889398 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-0b338b44-f24e-4fdb-ac4d-51774220d85f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Image pref 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:23:21.890028 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-0b338b44-f24e-4fdb-ac4d-51774220d85f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:23:21.906896 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0b338b44-f24e-4fdb-ac4d-51774220d85f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:21.907347 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0b338b44-f24e-4fdb-ac4d-51774220d85f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:21.908250 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0b338b44-f24e-4fdb-ac4d-51774220d85f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:21.908563 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0b338b44-f24e-4fdb-ac4d-51774220d85f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:21.927342 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-0b338b44-f24e-4fdb-ac4d-51774220d85f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Getting quotas for project 8f19c17b2ebe4eb9bf21ea3440988401. Resources: {'ram', 'cores', 'instances'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:23:21.932542 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-0b338b44-f24e-4fdb-ac4d-51774220d85f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Getting quotas for user cca8ccda749c4254bc186598e1f645c2 and project 8f19c17b2ebe4eb9bf21ea3440988401. Resources: {'ram', 'cores', 'instances'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:23:21.945590 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0b338b44-f24e-4fdb-ac4d-51774220d85f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Going to run 1 instances... {{(pid=118246) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:23:21.948090 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0b338b44-f24e-4fdb-ac4d-51774220d85f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118246) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:23:22.067241 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0b338b44-f24e-4fdb-ac4d-51774220d85f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 15.784621 Aug 01 14:23:22.068086 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 175/346] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:23:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 15786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:23:22.073717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-37ba57cc-4f0b-46f9-ba6c-3f80f7c7d83a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:22.075029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-37ba57cc-4f0b-46f9-ba6c-3f80f7c7d83a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:22.082342 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-37ba57cc-4f0b-46f9-ba6c-3f80f7c7d83a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.083212 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-37ba57cc-4f0b-46f9-ba6c-3f80f7c7d83a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:22.084916 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-37ba57cc-4f0b-46f9-ba6c-3f80f7c7d83a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.085591 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-37ba57cc-4f0b-46f9-ba6c-3f80f7c7d83a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:22.352057 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-37ba57cc-4f0b-46f9-ba6c-3f80f7c7d83a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:22.354534 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-3c91ec2d-3870-4124-910b-aad6ffdaa765 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Flavor limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:23:22.355116 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-3c91ec2d-3870-4124-910b-aad6ffdaa765 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Image limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:23:22.355849 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-3c91ec2d-3870-4124-910b-aad6ffdaa765 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Flavor pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:23:22.356389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-3c91ec2d-3870-4124-910b-aad6ffdaa765 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Image pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:23:22.356955 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-3c91ec2d-3870-4124-910b-aad6ffdaa765 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:23:22.361631 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-37ba57cc-4f0b-46f9-ba6c-3f80f7c7d83a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1700 microversion: 2.1 time: 0.291795 Aug 01 14:23:22.362607 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 176/347] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:22 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1700 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:22.368040 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-a9e42894-3c60-42d2-8d6e-b25be3404259 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:22.369094 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3c91ec2d-3870-4124-910b-aad6ffdaa765 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.369354 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-a9e42894-3c60-42d2-8d6e-b25be3404259 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:22.369688 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3c91ec2d-3870-4124-910b-aad6ffdaa765 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:22.370818 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3c91ec2d-3870-4124-910b-aad6ffdaa765 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.371496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3c91ec2d-3870-4124-910b-aad6ffdaa765 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:22.377098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a9e42894-3c60-42d2-8d6e-b25be3404259 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.377624 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a9e42894-3c60-42d2-8d6e-b25be3404259 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:22.378449 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a9e42894-3c60-42d2-8d6e-b25be3404259 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.379345 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a9e42894-3c60-42d2-8d6e-b25be3404259 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:22.399499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-3c91ec2d-3870-4124-910b-aad6ffdaa765 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Getting quotas for project c80bd4eb290541d8a713ea5ba60d0de4. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:23:22.403702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-3c91ec2d-3870-4124-910b-aad6ffdaa765 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Getting quotas for user 6b46ac5a29594c41a83e70838b0a13c8 and project c80bd4eb290541d8a713ea5ba60d0de4. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:23:22.418636 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3c91ec2d-3870-4124-910b-aad6ffdaa765 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Going to run 1 instances... {{(pid=118247) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:23:22.422042 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3c91ec2d-3870-4124-910b-aad6ffdaa765 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118247) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:23:22.547666 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3c91ec2d-3870-4124-910b-aad6ffdaa765 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 13.502623 Aug 01 14:23:22.549260 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 172/348] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:23:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 13505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:23:22.556443 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-72f9feef-f3a5-44f5-b79a-f9f95991a25a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:22.558318 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-72f9feef-f3a5-44f5-b79a-f9f95991a25a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:22.565537 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a9e42894-3c60-42d2-8d6e-b25be3404259 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:22.576230 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a9e42894-3c60-42d2-8d6e-b25be3404259 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:22.578056 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a9e42894-3c60-42d2-8d6e-b25be3404259 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:22.579572 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-a9e42894-3c60-42d2-8d6e-b25be3404259 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1740 microversion: 2.20 time: 0.215936 Aug 01 14:23:22.580905 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 177/349] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:22 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:22.587257 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ea904000-6b47-4e82-9bdc-5badfeb48f4f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:22.629254 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ea904000-6b47-4e82-9bdc-5badfeb48f4f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.629850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ea904000-6b47-4e82-9bdc-5badfeb48f4f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:22.642870 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-72f9feef-f3a5-44f5-b79a-f9f95991a25a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:22.653557 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-72f9feef-f3a5-44f5-b79a-f9f95991a25a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1215 microversion: 2.1 time: 0.102630 Aug 01 14:23:22.654154 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 173/350] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:22 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:22.659503 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-14b5af5f-a8d3-4e26-bdfe-f237aa2f133e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:22.660363 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-14b5af5f-a8d3-4e26-bdfe-f237aa2f133e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:22.745404 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ea904000-6b47-4e82-9bdc-5badfeb48f4f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Going to try to start instance {{(pid=118246) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 14:23:22.747530 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-14b5af5f-a8d3-4e26-bdfe-f237aa2f133e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:22.755456 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-14b5af5f-a8d3-4e26-bdfe-f237aa2f133e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1244 microversion: 2.1 time: 0.099455 Aug 01 14:23:22.756680 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 174/351] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:22 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1244 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:22.976037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ea904000-6b47-4e82-9bdc-5badfeb48f4f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "POST /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/action" status: 202 len: 0 microversion: 2.1 time: 0.392183 Aug 01 14:23:22.976574 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 178/352] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Aug 1 14:23:22 2022] POST /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:23:22.986279 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b5d53a20-2df9-479e-93b7-c182815c60b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:22.987592 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b5d53a20-2df9-479e-93b7-c182815c60b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:22.996727 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b5d53a20-2df9-479e-93b7-c182815c60b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:22.997590 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b5d53a20-2df9-479e-93b7-c182815c60b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:23.003651 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b5d53a20-2df9-479e-93b7-c182815c60b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:23.003651 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b5d53a20-2df9-479e-93b7-c182815c60b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:23.256440 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b5d53a20-2df9-479e-93b7-c182815c60b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:23.265157 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b5d53a20-2df9-479e-93b7-c182815c60b9 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1709 microversion: 2.1 time: 0.282630 Aug 01 14:23:23.265737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 175/353] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:22 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1709 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:23.616601 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4427553d-7517-4f8c-8270-430c2a3709d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:23.619176 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4427553d-7517-4f8c-8270-430c2a3709d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:23.627047 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4427553d-7517-4f8c-8270-430c2a3709d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:23.627497 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4427553d-7517-4f8c-8270-430c2a3709d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:23.628331 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4427553d-7517-4f8c-8270-430c2a3709d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:23.628787 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4427553d-7517-4f8c-8270-430c2a3709d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:23.674929 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b3023c04-ebeb-428e-a686-780f530e972a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:23.675554 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b3023c04-ebeb-428e-a686-780f530e972a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:23.683699 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b3023c04-ebeb-428e-a686-780f530e972a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:23.684142 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b3023c04-ebeb-428e-a686-780f530e972a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:23.684929 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b3023c04-ebeb-428e-a686-780f530e972a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:23.685658 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b3023c04-ebeb-428e-a686-780f530e972a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:23.777113 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b3023c04-ebeb-428e-a686-780f530e972a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:23.788421 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b3023c04-ebeb-428e-a686-780f530e972a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1219 microversion: 2.1 time: 0.117505 Aug 01 14:23:23.803390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 176/354] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:23 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:23.829138 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d82f7d2d-5579-4695-93bb-c38c3957097d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:23.831949 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d82f7d2d-5579-4695-93bb-c38c3957097d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:23.846077 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4427553d-7517-4f8c-8270-430c2a3709d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:23.857145 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4427553d-7517-4f8c-8270-430c2a3709d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:23.864771 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4427553d-7517-4f8c-8270-430c2a3709d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:23.873291 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4427553d-7517-4f8c-8270-430c2a3709d9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1740 microversion: 2.20 time: 0.263945 Aug 01 14:23:23.889984 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 179/355] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:23 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:23.916932 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d82f7d2d-5579-4695-93bb-c38c3957097d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:23.934611 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d82f7d2d-5579-4695-93bb-c38c3957097d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1244 microversion: 2.1 time: 0.129977 Aug 01 14:23:23.937700 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 177/356] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:23 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1244 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:24.288939 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-97ed4d49-8ff2-4a4b-952c-aa4d70ff5358 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:24.289604 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-97ed4d49-8ff2-4a4b-952c-aa4d70ff5358 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:24.300046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-97ed4d49-8ff2-4a4b-952c-aa4d70ff5358 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.300501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-97ed4d49-8ff2-4a4b-952c-aa4d70ff5358 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:24.301282 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-97ed4d49-8ff2-4a4b-952c-aa4d70ff5358 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.301719 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-97ed4d49-8ff2-4a4b-952c-aa4d70ff5358 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:24.498131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-97ed4d49-8ff2-4a4b-952c-aa4d70ff5358 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:24.510773 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-97ed4d49-8ff2-4a4b-952c-aa4d70ff5358 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1709 microversion: 2.1 time: 0.226572 Aug 01 14:23:24.512441 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 180/357] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:24 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1709 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:24.813276 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-8e260797-f1df-467f-855d-099a71474726 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:24.813925 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-8e260797-f1df-467f-855d-099a71474726 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:24.820841 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8e260797-f1df-467f-855d-099a71474726 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.821563 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8e260797-f1df-467f-855d-099a71474726 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:24.822429 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8e260797-f1df-467f-855d-099a71474726 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.823134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8e260797-f1df-467f-855d-099a71474726 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:24.890167 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-8e260797-f1df-467f-855d-099a71474726 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:24.899133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-8e260797-f1df-467f-855d-099a71474726 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1219 microversion: 2.1 time: 0.089822 Aug 01 14:23:24.899406 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c77e81a4-3269-49df-ad29-291ed2312047 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:24.900004 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 178/358] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:24 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:24.913435 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c77e81a4-3269-49df-ad29-291ed2312047 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:24.923982 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c77e81a4-3269-49df-ad29-291ed2312047 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.924929 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c77e81a4-3269-49df-ad29-291ed2312047 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:24.926899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c77e81a4-3269-49df-ad29-291ed2312047 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.927711 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c77e81a4-3269-49df-ad29-291ed2312047 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:24.956363 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a44720dd-e671-453f-b05f-cda029a62b1c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:24.957180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a44720dd-e671-453f-b05f-cda029a62b1c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:24.978404 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a44720dd-e671-453f-b05f-cda029a62b1c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.979228 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a44720dd-e671-453f-b05f-cda029a62b1c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:24.990985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a44720dd-e671-453f-b05f-cda029a62b1c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:24.991822 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a44720dd-e671-453f-b05f-cda029a62b1c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:25.080446 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a44720dd-e671-453f-b05f-cda029a62b1c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:25.092758 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a44720dd-e671-453f-b05f-cda029a62b1c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1248 microversion: 2.1 time: 0.139791 Aug 01 14:23:25.093639 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 179/359] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:24 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1248 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:25.119344 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c77e81a4-3269-49df-ad29-291ed2312047 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:25.127575 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c77e81a4-3269-49df-ad29-291ed2312047 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:25.129129 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c77e81a4-3269-49df-ad29-291ed2312047 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:25.130344 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c77e81a4-3269-49df-ad29-291ed2312047 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1740 microversion: 2.20 time: 0.237176 Aug 01 14:23:25.132077 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 181/360] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:24 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:25.534230 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-29210afc-ca29-401c-8846-82bf0ce0685e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:25.535544 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-29210afc-ca29-401c-8846-82bf0ce0685e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:25.544409 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-29210afc-ca29-401c-8846-82bf0ce0685e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:25.544878 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-29210afc-ca29-401c-8846-82bf0ce0685e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:25.545676 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-29210afc-ca29-401c-8846-82bf0ce0685e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:25.546221 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-29210afc-ca29-401c-8846-82bf0ce0685e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:25.691143 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-29210afc-ca29-401c-8846-82bf0ce0685e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:25.700268 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-29210afc-ca29-401c-8846-82bf0ce0685e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1709 microversion: 2.1 time: 0.170123 Aug 01 14:23:25.701054 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 180/361] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:25 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1709 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:25.919851 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-9d6573a3-3d87-4b18-ae4f-f3be07aecb13 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:25.920407 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-9d6573a3-3d87-4b18-ae4f-f3be07aecb13 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:25.929203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9d6573a3-3d87-4b18-ae4f-f3be07aecb13 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:25.929997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9d6573a3-3d87-4b18-ae4f-f3be07aecb13 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:25.930778 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9d6573a3-3d87-4b18-ae4f-f3be07aecb13 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:25.931379 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9d6573a3-3d87-4b18-ae4f-f3be07aecb13 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:26.019498 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-9d6573a3-3d87-4b18-ae4f-f3be07aecb13 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:26.028434 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-9d6573a3-3d87-4b18-ae4f-f3be07aecb13 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1219 microversion: 2.1 time: 0.112486 Aug 01 14:23:26.029161 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 182/362] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:25 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:26.114511 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b929977a-cf1b-411a-9b01-e79836a9440f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:26.118674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b929977a-cf1b-411a-9b01-e79836a9440f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:26.127678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b929977a-cf1b-411a-9b01-e79836a9440f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:26.128759 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b929977a-cf1b-411a-9b01-e79836a9440f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:26.130552 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b929977a-cf1b-411a-9b01-e79836a9440f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:26.131971 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b929977a-cf1b-411a-9b01-e79836a9440f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:26.155152 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-dae62f98-1ff0-4039-9c7e-ec2c3a786f04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:26.157216 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-dae62f98-1ff0-4039-9c7e-ec2c3a786f04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:26.169737 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dae62f98-1ff0-4039-9c7e-ec2c3a786f04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:26.173509 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dae62f98-1ff0-4039-9c7e-ec2c3a786f04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:26.173509 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dae62f98-1ff0-4039-9c7e-ec2c3a786f04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:26.173509 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dae62f98-1ff0-4039-9c7e-ec2c3a786f04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:26.251956 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b929977a-cf1b-411a-9b01-e79836a9440f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:26.268437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b929977a-cf1b-411a-9b01-e79836a9440f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1248 microversion: 2.1 time: 0.158144 Aug 01 14:23:26.274934 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 181/363] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:26 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1248 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:26.446313 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-dae62f98-1ff0-4039-9c7e-ec2c3a786f04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:26.455563 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-dae62f98-1ff0-4039-9c7e-ec2c3a786f04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:26.457380 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-dae62f98-1ff0-4039-9c7e-ec2c3a786f04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:26.458730 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-dae62f98-1ff0-4039-9c7e-ec2c3a786f04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1740 microversion: 2.20 time: 0.308463 Aug 01 14:23:26.469543 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 183/364] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:26 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1740 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:26.726984 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f9931a80-642e-4c4e-8c5e-b8e7efac943c tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:26.727958 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f9931a80-642e-4c4e-8c5e-b8e7efac943c tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:26.734815 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f9931a80-642e-4c4e-8c5e-b8e7efac943c tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:26.735348 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f9931a80-642e-4c4e-8c5e-b8e7efac943c tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:26.736237 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f9931a80-642e-4c4e-8c5e-b8e7efac943c tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:26.736903 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f9931a80-642e-4c4e-8c5e-b8e7efac943c tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:26.893921 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f9931a80-642e-4c4e-8c5e-b8e7efac943c tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:26.924951 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f9931a80-642e-4c4e-8c5e-b8e7efac943c tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1709 microversion: 2.1 time: 0.206459 Aug 01 14:23:26.925557 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 182/365] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:26 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1709 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:27.050844 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-6ed0c922-2216-401a-b51d-fd599d8911d3 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:27.052129 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-6ed0c922-2216-401a-b51d-fd599d8911d3 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:27.066235 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6ed0c922-2216-401a-b51d-fd599d8911d3 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:27.067578 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6ed0c922-2216-401a-b51d-fd599d8911d3 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:27.068786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6ed0c922-2216-401a-b51d-fd599d8911d3 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:27.069906 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6ed0c922-2216-401a-b51d-fd599d8911d3 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:27.152553 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-6ed0c922-2216-401a-b51d-fd599d8911d3 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:27.161643 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-6ed0c922-2216-401a-b51d-fd599d8911d3 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1211 microversion: 2.1 time: 0.114608 Aug 01 14:23:27.163674 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 184/366] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:27 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1211 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:27.302679 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-fc16ff63-f341-4be7-9b12-3c19f575f66a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:27.305554 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-fc16ff63-f341-4be7-9b12-3c19f575f66a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:27.317668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fc16ff63-f341-4be7-9b12-3c19f575f66a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:27.324613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fc16ff63-f341-4be7-9b12-3c19f575f66a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:27.326926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fc16ff63-f341-4be7-9b12-3c19f575f66a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:27.327946 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fc16ff63-f341-4be7-9b12-3c19f575f66a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:27.476895 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-fc16ff63-f341-4be7-9b12-3c19f575f66a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:27.495175 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-47b5d920-8402-4254-bd91-5fc44f371b5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:27.508420 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-47b5d920-8402-4254-bd91-5fc44f371b5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:27.519771 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-fc16ff63-f341-4be7-9b12-3c19f575f66a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1240 microversion: 2.1 time: 0.225334 Aug 01 14:23:27.522541 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 183/367] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:27 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1240 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:27.528010 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-47b5d920-8402-4254-bd91-5fc44f371b5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:27.528652 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-47b5d920-8402-4254-bd91-5fc44f371b5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:27.529424 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-47b5d920-8402-4254-bd91-5fc44f371b5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:27.530021 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-47b5d920-8402-4254-bd91-5fc44f371b5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:27.699213 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-47b5d920-8402-4254-bd91-5fc44f371b5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:27.712795 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-47b5d920-8402-4254-bd91-5fc44f371b5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:27.714782 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-47b5d920-8402-4254-bd91-5fc44f371b5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:27.716036 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-47b5d920-8402-4254-bd91-5fc44f371b5b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1740 microversion: 2.20 time: 0.234655 Aug 01 14:23:27.716964 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 185/368] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:27 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:27.948937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-87173b37-71ea-4ac6-94fd-92b79344afbd tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:27.949585 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-87173b37-71ea-4ac6-94fd-92b79344afbd tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:27.955690 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-87173b37-71ea-4ac6-94fd-92b79344afbd tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:27.956347 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-87173b37-71ea-4ac6-94fd-92b79344afbd tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:27.957125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-87173b37-71ea-4ac6-94fd-92b79344afbd tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:27.957565 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-87173b37-71ea-4ac6-94fd-92b79344afbd tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:28.116664 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-87173b37-71ea-4ac6-94fd-92b79344afbd tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:28.125619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-87173b37-71ea-4ac6-94fd-92b79344afbd tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1709 microversion: 2.1 time: 0.181316 Aug 01 14:23:28.126301 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 184/369] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:27 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1709 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:28.187288 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1c4f5fa8-557c-4337-a24b-204a3eb35b10 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:28.188494 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-1c4f5fa8-557c-4337-a24b-204a3eb35b10 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:28.195707 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1c4f5fa8-557c-4337-a24b-204a3eb35b10 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:28.196391 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1c4f5fa8-557c-4337-a24b-204a3eb35b10 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:28.197168 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1c4f5fa8-557c-4337-a24b-204a3eb35b10 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:28.197782 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1c4f5fa8-557c-4337-a24b-204a3eb35b10 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:28.269332 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-1c4f5fa8-557c-4337-a24b-204a3eb35b10 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:28.279852 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-1c4f5fa8-557c-4337-a24b-204a3eb35b10 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1267 microversion: 2.1 time: 0.098015 Aug 01 14:23:28.280460 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 186/370] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:28 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:28.549997 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0734db5a-57a4-4650-b1a6-6d066a5de924 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:28.550827 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0734db5a-57a4-4650-b1a6-6d066a5de924 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:28.557603 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0734db5a-57a4-4650-b1a6-6d066a5de924 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:28.558161 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0734db5a-57a4-4650-b1a6-6d066a5de924 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:28.559040 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0734db5a-57a4-4650-b1a6-6d066a5de924 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:28.559585 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0734db5a-57a4-4650-b1a6-6d066a5de924 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:28.638444 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0734db5a-57a4-4650-b1a6-6d066a5de924 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:28.648674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0734db5a-57a4-4650-b1a6-6d066a5de924 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1240 microversion: 2.1 time: 0.104209 Aug 01 14:23:28.649854 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 185/371] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:28 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1240 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:28.740896 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-211b259f-66d6-4270-bc52-11eeceefe036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:28.741892 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-211b259f-66d6-4270-bc52-11eeceefe036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:28.749948 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-211b259f-66d6-4270-bc52-11eeceefe036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:28.750830 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-211b259f-66d6-4270-bc52-11eeceefe036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:28.751632 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-211b259f-66d6-4270-bc52-11eeceefe036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:28.751632 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-211b259f-66d6-4270-bc52-11eeceefe036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:28.923792 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-211b259f-66d6-4270-bc52-11eeceefe036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:28.934168 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-211b259f-66d6-4270-bc52-11eeceefe036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:28.936896 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-211b259f-66d6-4270-bc52-11eeceefe036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:28.937168 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-211b259f-66d6-4270-bc52-11eeceefe036 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1740 microversion: 2.20 time: 0.200603 Aug 01 14:23:28.937731 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 187/372] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:28 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:29.149776 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f0b5ad43-9074-4e1c-8b4d-6b3fbb06b3ff tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:29.150642 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f0b5ad43-9074-4e1c-8b4d-6b3fbb06b3ff tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:29.158050 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f0b5ad43-9074-4e1c-8b4d-6b3fbb06b3ff tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.158785 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f0b5ad43-9074-4e1c-8b4d-6b3fbb06b3ff tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.159639 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f0b5ad43-9074-4e1c-8b4d-6b3fbb06b3ff tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.160135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f0b5ad43-9074-4e1c-8b4d-6b3fbb06b3ff tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.302217 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f0b5ad43-9074-4e1c-8b4d-6b3fbb06b3ff tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:29.302382 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-32895ecb-bbb4-45bc-9064-48eefddbbd3a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:29.302382 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-32895ecb-bbb4-45bc-9064-48eefddbbd3a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:29.307090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f0b5ad43-9074-4e1c-8b4d-6b3fbb06b3ff tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1709 microversion: 2.1 time: 0.162696 Aug 01 14:23:29.307747 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 186/373] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:29 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1709 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:29.307989 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-32895ecb-bbb4-45bc-9064-48eefddbbd3a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.308442 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-32895ecb-bbb4-45bc-9064-48eefddbbd3a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.309289 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-32895ecb-bbb4-45bc-9064-48eefddbbd3a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.309733 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-32895ecb-bbb4-45bc-9064-48eefddbbd3a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.374185 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-32895ecb-bbb4-45bc-9064-48eefddbbd3a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:29.383032 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-32895ecb-bbb4-45bc-9064-48eefddbbd3a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1267 microversion: 2.1 time: 0.085539 Aug 01 14:23:29.383598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 188/374] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:29 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:29.669809 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0a16064b-332c-4c90-83b5-513fcd987cc5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:29.671096 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0a16064b-332c-4c90-83b5-513fcd987cc5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:29.677661 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0a16064b-332c-4c90-83b5-513fcd987cc5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.678800 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0a16064b-332c-4c90-83b5-513fcd987cc5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.679644 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0a16064b-332c-4c90-83b5-513fcd987cc5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.680723 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0a16064b-332c-4c90-83b5-513fcd987cc5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.745708 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0a16064b-332c-4c90-83b5-513fcd987cc5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:29.759891 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0a16064b-332c-4c90-83b5-513fcd987cc5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1240 microversion: 2.1 time: 0.093564 Aug 01 14:23:29.763137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 187/375] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:29 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:29.966145 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d0f3d0ee-13ee-48a9-b782-369292225a1e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:29.968291 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d0f3d0ee-13ee-48a9-b782-369292225a1e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:29.983276 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d0f3d0ee-13ee-48a9-b782-369292225a1e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.984036 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d0f3d0ee-13ee-48a9-b782-369292225a1e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:29.984857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d0f3d0ee-13ee-48a9-b782-369292225a1e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:29.985320 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d0f3d0ee-13ee-48a9-b782-369292225a1e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:30.134127 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d0f3d0ee-13ee-48a9-b782-369292225a1e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:30.142689 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d0f3d0ee-13ee-48a9-b782-369292225a1e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:30.144318 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d0f3d0ee-13ee-48a9-b782-369292225a1e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:30.145555 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d0f3d0ee-13ee-48a9-b782-369292225a1e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1740 microversion: 2.20 time: 0.185082 Aug 01 14:23:30.149788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 189/376] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:29 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:30.329458 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-753656eb-cb09-4cf7-8ca7-8d869165f0ee tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:30.330079 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-753656eb-cb09-4cf7-8ca7-8d869165f0ee tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:30.337614 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-753656eb-cb09-4cf7-8ca7-8d869165f0ee tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:30.338091 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-753656eb-cb09-4cf7-8ca7-8d869165f0ee tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:30.338858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-753656eb-cb09-4cf7-8ca7-8d869165f0ee tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:30.339316 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-753656eb-cb09-4cf7-8ca7-8d869165f0ee tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:30.403894 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-fff06eec-4180-4816-b1af-cdc2ac115f19 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:30.404565 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-fff06eec-4180-4816-b1af-cdc2ac115f19 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:30.414391 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fff06eec-4180-4816-b1af-cdc2ac115f19 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:30.417732 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fff06eec-4180-4816-b1af-cdc2ac115f19 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:30.418801 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fff06eec-4180-4816-b1af-cdc2ac115f19 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:30.419426 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fff06eec-4180-4816-b1af-cdc2ac115f19 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:30.500675 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-fff06eec-4180-4816-b1af-cdc2ac115f19 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:30.511026 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-fff06eec-4180-4816-b1af-cdc2ac115f19 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1267 microversion: 2.1 time: 0.110959 Aug 01 14:23:30.512198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 190/377] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:30 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1267 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:30.550857 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-753656eb-cb09-4cf7-8ca7-8d869165f0ee tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:30.565951 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-753656eb-cb09-4cf7-8ca7-8d869165f0ee tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1709 microversion: 2.1 time: 0.240573 Aug 01 14:23:30.567045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 188/378] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:30 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1709 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:30.782483 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-78391793-1ab7-4978-bcbd-57654a622c62 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:30.783597 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-78391793-1ab7-4978-bcbd-57654a622c62 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:30.791120 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-78391793-1ab7-4978-bcbd-57654a622c62 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:30.791502 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-78391793-1ab7-4978-bcbd-57654a622c62 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:30.792490 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-78391793-1ab7-4978-bcbd-57654a622c62 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:30.793090 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-78391793-1ab7-4978-bcbd-57654a622c62 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:30.798134 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:30.863482 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-78391793-1ab7-4978-bcbd-57654a622c62 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:30.872028 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-78391793-1ab7-4978-bcbd-57654a622c62 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1240 microversion: 2.1 time: 0.093539 Aug 01 14:23:30.882361 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 191/379] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:30 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:31.169970 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4d0b3a11-cdfe-4d4b-99a1-6d37ef6ee89b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:31.170704 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-4d0b3a11-cdfe-4d4b-99a1-6d37ef6ee89b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:31.181394 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4d0b3a11-cdfe-4d4b-99a1-6d37ef6ee89b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:31.181896 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4d0b3a11-cdfe-4d4b-99a1-6d37ef6ee89b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:31.182683 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4d0b3a11-cdfe-4d4b-99a1-6d37ef6ee89b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:31.183130 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4d0b3a11-cdfe-4d4b-99a1-6d37ef6ee89b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:31.367723 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4d0b3a11-cdfe-4d4b-99a1-6d37ef6ee89b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:31.378724 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4d0b3a11-cdfe-4d4b-99a1-6d37ef6ee89b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:31.381547 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4d0b3a11-cdfe-4d4b-99a1-6d37ef6ee89b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:31.384308 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4d0b3a11-cdfe-4d4b-99a1-6d37ef6ee89b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1740 microversion: 2.20 time: 0.218078 Aug 01 14:23:31.402489 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 189/380] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:31 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:31.533700 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-a50d7c15-a06d-4a21-9b70-57c79c6f843c tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:31.534834 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-a50d7c15-a06d-4a21-9b70-57c79c6f843c tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:31.549477 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a50d7c15-a06d-4a21-9b70-57c79c6f843c tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:31.550712 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a50d7c15-a06d-4a21-9b70-57c79c6f843c tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:31.552054 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a50d7c15-a06d-4a21-9b70-57c79c6f843c tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:31.554647 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a50d7c15-a06d-4a21-9b70-57c79c6f843c tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:31.589873 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-502f6a95-8c9b-443c-8fc8-51dd3f98dd58 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:31.590856 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-502f6a95-8c9b-443c-8fc8-51dd3f98dd58 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:31.602862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-502f6a95-8c9b-443c-8fc8-51dd3f98dd58 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:31.603586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-502f6a95-8c9b-443c-8fc8-51dd3f98dd58 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:31.604696 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-502f6a95-8c9b-443c-8fc8-51dd3f98dd58 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:31.605594 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-502f6a95-8c9b-443c-8fc8-51dd3f98dd58 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:31.700061 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a50d7c15-a06d-4a21-9b70-57c79c6f843c tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:31.713233 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-a50d7c15-a06d-4a21-9b70-57c79c6f843c tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1275 microversion: 2.1 time: 0.183643 Aug 01 14:23:31.714665 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 192/381] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:31 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1275 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:31.820251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-502f6a95-8c9b-443c-8fc8-51dd3f98dd58 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:31.828445 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-502f6a95-8c9b-443c-8fc8-51dd3f98dd58 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1709 microversion: 2.1 time: 0.242982 Aug 01 14:23:31.836030 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 190/382] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:31 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1709 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:31.894387 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1ad7d24c-c4f2-4fbb-985a-a2901145a48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:31.895286 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-1ad7d24c-c4f2-4fbb-985a-a2901145a48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:31.903089 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1ad7d24c-c4f2-4fbb-985a-a2901145a48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:31.903650 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1ad7d24c-c4f2-4fbb-985a-a2901145a48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:31.904390 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1ad7d24c-c4f2-4fbb-985a-a2901145a48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:31.904833 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1ad7d24c-c4f2-4fbb-985a-a2901145a48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:31.921682 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=2 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:31.949138 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=6 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:31.973972 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-1ad7d24c-c4f2-4fbb-985a-a2901145a48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:31.983192 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-1ad7d24c-c4f2-4fbb-985a-a2901145a48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1296 microversion: 2.1 time: 0.092905 Aug 01 14:23:31.988815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 193/383] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:31 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:32.409045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7680a2ad-1a26-49b3-b7a0-c4382ab6779c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:32.409734 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7680a2ad-1a26-49b3-b7a0-c4382ab6779c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:32.414253 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=2 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:32.418420 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7680a2ad-1a26-49b3-b7a0-c4382ab6779c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:32.418973 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7680a2ad-1a26-49b3-b7a0-c4382ab6779c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:32.420099 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7680a2ad-1a26-49b3-b7a0-c4382ab6779c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:32.420631 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7680a2ad-1a26-49b3-b7a0-c4382ab6779c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:32.585339 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7680a2ad-1a26-49b3-b7a0-c4382ab6779c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:32.594125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7680a2ad-1a26-49b3-b7a0-c4382ab6779c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:32.596386 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7680a2ad-1a26-49b3-b7a0-c4382ab6779c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:32.597571 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7680a2ad-1a26-49b3-b7a0-c4382ab6779c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1740 microversion: 2.20 time: 0.192899 Aug 01 14:23:32.598156 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 191/384] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:32 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:32.735310 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-43792e99-1371-4f29-9d99-0fb4b6246cab tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:32.736045 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-43792e99-1371-4f29-9d99-0fb4b6246cab tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:32.745079 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-43792e99-1371-4f29-9d99-0fb4b6246cab tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:32.745533 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-43792e99-1371-4f29-9d99-0fb4b6246cab tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:32.746338 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-43792e99-1371-4f29-9d99-0fb4b6246cab tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:32.746779 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-43792e99-1371-4f29-9d99-0fb4b6246cab tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:32.810661 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-43792e99-1371-4f29-9d99-0fb4b6246cab tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:32.819156 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-43792e99-1371-4f29-9d99-0fb4b6246cab tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1273 microversion: 2.1 time: 0.087323 Aug 01 14:23:32.821460 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 194/385] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:32 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:32.850972 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0f6aac36-1b20-48f6-b284-64f1ddf1cfa2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:32.851680 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0f6aac36-1b20-48f6-b284-64f1ddf1cfa2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:32.858130 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0f6aac36-1b20-48f6-b284-64f1ddf1cfa2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:32.858592 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0f6aac36-1b20-48f6-b284-64f1ddf1cfa2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:32.859415 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0f6aac36-1b20-48f6-b284-64f1ddf1cfa2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:32.859865 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0f6aac36-1b20-48f6-b284-64f1ddf1cfa2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:32.866146 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=100 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:33.006472 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c3be196a-da57-43b0-9438-61511d287362 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:33.007213 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c3be196a-da57-43b0-9438-61511d287362 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:33.021858 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c3be196a-da57-43b0-9438-61511d287362 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.021858 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c3be196a-da57-43b0-9438-61511d287362 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.023960 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c3be196a-da57-43b0-9438-61511d287362 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.024956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c3be196a-da57-43b0-9438-61511d287362 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.066066 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0f6aac36-1b20-48f6-b284-64f1ddf1cfa2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:33.076738 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0f6aac36-1b20-48f6-b284-64f1ddf1cfa2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1709 microversion: 2.1 time: 0.231028 Aug 01 14:23:33.084475 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 192/386] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:32 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1709 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:33.149950 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c3be196a-da57-43b0-9438-61511d287362 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:33.164900 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c3be196a-da57-43b0-9438-61511d287362 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1304 microversion: 2.1 time: 0.162898 Aug 01 14:23:33.165808 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 195/387] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:33 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1304 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:33.624286 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-8ac93556-6066-4621-bf40-da1c400fb4b1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:33.626224 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-8ac93556-6066-4621-bf40-da1c400fb4b1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:33.634932 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8ac93556-6066-4621-bf40-da1c400fb4b1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.635891 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8ac93556-6066-4621-bf40-da1c400fb4b1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.636958 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8ac93556-6066-4621-bf40-da1c400fb4b1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.637579 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8ac93556-6066-4621-bf40-da1c400fb4b1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.810262 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-8ac93556-6066-4621-bf40-da1c400fb4b1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:33.829705 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-8ac93556-6066-4621-bf40-da1c400fb4b1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:33.831396 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-8ac93556-6066-4621-bf40-da1c400fb4b1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:33.832827 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-8ac93556-6066-4621-bf40-da1c400fb4b1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1740 microversion: 2.20 time: 0.215576 Aug 01 14:23:33.833640 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 193/388] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:33 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:33.859584 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-87d73865-a233-49cd-9453-e457824233c6 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:33.864430 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-87d73865-a233-49cd-9453-e457824233c6 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:33.877509 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-87d73865-a233-49cd-9453-e457824233c6 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.879918 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-87d73865-a233-49cd-9453-e457824233c6 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.879918 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-87d73865-a233-49cd-9453-e457824233c6 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:33.879918 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-87d73865-a233-49cd-9453-e457824233c6 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:33.947780 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-87d73865-a233-49cd-9453-e457824233c6 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:33.955554 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-87d73865-a233-49cd-9453-e457824233c6 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1273 microversion: 2.1 time: 0.103102 Aug 01 14:23:33.956124 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 196/389] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:33 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:34.105788 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-fee47cac-319f-43c4-8fcb-b18f28434e5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:34.106513 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-fee47cac-319f-43c4-8fcb-b18f28434e5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:34.108584 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=12 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:34.117497 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fee47cac-319f-43c4-8fcb-b18f28434e5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.118456 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fee47cac-319f-43c4-8fcb-b18f28434e5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.119245 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fee47cac-319f-43c4-8fcb-b18f28434e5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.119698 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fee47cac-319f-43c4-8fcb-b18f28434e5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.191874 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-61161a94-3717-4917-982b-636a700ee03e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:34.192509 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-61161a94-3717-4917-982b-636a700ee03e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:34.201269 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-61161a94-3717-4917-982b-636a700ee03e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.201269 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-61161a94-3717-4917-982b-636a700ee03e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.202987 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-61161a94-3717-4917-982b-636a700ee03e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.203566 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-61161a94-3717-4917-982b-636a700ee03e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.285107 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-61161a94-3717-4917-982b-636a700ee03e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:34.302151 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-61161a94-3717-4917-982b-636a700ee03e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1302 microversion: 2.1 time: 0.115979 Aug 01 14:23:34.303317 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 197/390] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:34 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1302 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:34.307548 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-fee47cac-319f-43c4-8fcb-b18f28434e5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:34.316479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-fee47cac-319f-43c4-8fcb-b18f28434e5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1713 microversion: 2.1 time: 0.214575 Aug 01 14:23:34.328618 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 194/391] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:34 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1713 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:34.856972 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-2b884324-1135-4c1c-8d68-31c5ccb019c6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:34.857620 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-2b884324-1135-4c1c-8d68-31c5ccb019c6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:34.863597 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2b884324-1135-4c1c-8d68-31c5ccb019c6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.864146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2b884324-1135-4c1c-8d68-31c5ccb019c6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.864804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2b884324-1135-4c1c-8d68-31c5ccb019c6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.865925 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2b884324-1135-4c1c-8d68-31c5ccb019c6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.979331 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-580f80f3-89a8-406c-9bee-f5a40d0780b7 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:34.980612 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-580f80f3-89a8-406c-9bee-f5a40d0780b7 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:34.990100 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-580f80f3-89a8-406c-9bee-f5a40d0780b7 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.991010 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-580f80f3-89a8-406c-9bee-f5a40d0780b7 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:34.991802 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-580f80f3-89a8-406c-9bee-f5a40d0780b7 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:34.992245 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-580f80f3-89a8-406c-9bee-f5a40d0780b7 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:35.017696 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2b884324-1135-4c1c-8d68-31c5ccb019c6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:35.030165 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2b884324-1135-4c1c-8d68-31c5ccb019c6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:35.032113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2b884324-1135-4c1c-8d68-31c5ccb019c6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:35.033504 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-2b884324-1135-4c1c-8d68-31c5ccb019c6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1740 microversion: 2.20 time: 0.180451 Aug 01 14:23:35.034656 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 198/392] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:34 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:35.153379 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-580f80f3-89a8-406c-9bee-f5a40d0780b7 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:35.161012 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-580f80f3-89a8-406c-9bee-f5a40d0780b7 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1315 microversion: 2.1 time: 0.187630 Aug 01 14:23:35.161900 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 195/393] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:34 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:35.324381 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-311642ea-cc0a-456e-85b0-c22bd3898b74 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:35.324993 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-311642ea-cc0a-456e-85b0-c22bd3898b74 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:35.331312 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-311642ea-cc0a-456e-85b0-c22bd3898b74 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:35.331766 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-311642ea-cc0a-456e-85b0-c22bd3898b74 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:35.332530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-311642ea-cc0a-456e-85b0-c22bd3898b74 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:35.332987 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-311642ea-cc0a-456e-85b0-c22bd3898b74 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:35.470018 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-311642ea-cc0a-456e-85b0-c22bd3898b74 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:35.479018 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-311642ea-cc0a-456e-85b0-c22bd3898b74 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.158245 Aug 01 14:23:35.479990 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 199/394] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:35 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:36.057113 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3fa44285-06a1-4dc9-b849-0603f6eb5aaf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:36.057725 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3fa44285-06a1-4dc9-b849-0603f6eb5aaf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:36.063958 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3fa44285-06a1-4dc9-b849-0603f6eb5aaf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:36.064404 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3fa44285-06a1-4dc9-b849-0603f6eb5aaf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:36.065172 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3fa44285-06a1-4dc9-b849-0603f6eb5aaf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:36.065820 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3fa44285-06a1-4dc9-b849-0603f6eb5aaf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:36.187098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0e3610ae-4cd0-4a6a-bc2c-c1dea64456f4 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:36.187723 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0e3610ae-4cd0-4a6a-bc2c-c1dea64456f4 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:36.195506 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0e3610ae-4cd0-4a6a-bc2c-c1dea64456f4 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:36.196262 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0e3610ae-4cd0-4a6a-bc2c-c1dea64456f4 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:36.197317 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0e3610ae-4cd0-4a6a-bc2c-c1dea64456f4 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:36.197961 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0e3610ae-4cd0-4a6a-bc2c-c1dea64456f4 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:36.223179 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3fa44285-06a1-4dc9-b849-0603f6eb5aaf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:36.237280 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3fa44285-06a1-4dc9-b849-0603f6eb5aaf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:36.239413 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3fa44285-06a1-4dc9-b849-0603f6eb5aaf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:36.242187 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3fa44285-06a1-4dc9-b849-0603f6eb5aaf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1722 microversion: 2.20 time: 0.189341 Aug 01 14:23:36.243590 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 196/395] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:36 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:36.355143 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-0e3610ae-4cd0-4a6a-bc2c-c1dea64456f4 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:36.363491 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0e3610ae-4cd0-4a6a-bc2c-c1dea64456f4 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1315 microversion: 2.1 time: 0.180296 Aug 01 14:23:36.377700 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 200/396] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:36 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:36.429306 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-1aa560b0-5179-4db6-9571-95800bfeccb6 req-ab9537e5-c377-4b88-ba27-3d641ff3422a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32204f28-6a74-4eb5-acb0-29332869a35c", "tag": "f1925ba6-b627-4786-bebc-1d0f995e5cfa"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:36.439156 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-1aa560b0-5179-4db6-9571-95800bfeccb6 req-ab9537e5-c377-4b88-ba27-3d641ff3422a service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:36.439628 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-1aa560b0-5179-4db6-9571-95800bfeccb6 req-ab9537e5-c377-4b88-ba27-3d641ff3422a service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:36.452480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-1aa560b0-5179-4db6-9571-95800bfeccb6 req-ab9537e5-c377-4b88-ba27-3d641ff3422a service nova] Creating event network-changed:f1925ba6-b627-4786-bebc-1d0f995e5cfa for instance 32204f28-6a74-4eb5-acb0-29332869a35c on hv-cinder-78729 Aug 01 14:23:36.457565 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-1aa560b0-5179-4db6-9571-95800bfeccb6 req-ab9537e5-c377-4b88-ba27-3d641ff3422a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032898 Aug 01 14:23:36.461239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 197/397] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:23:36.501265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ff95249e-49a1-4316-835a-3bad86d6e39b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:36.502007 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ff95249e-49a1-4316-835a-3bad86d6e39b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:36.509253 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ff95249e-49a1-4316-835a-3bad86d6e39b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:36.509820 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ff95249e-49a1-4316-835a-3bad86d6e39b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:36.510768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ff95249e-49a1-4316-835a-3bad86d6e39b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:36.511270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ff95249e-49a1-4316-835a-3bad86d6e39b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:36.652510 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ff95249e-49a1-4316-835a-3bad86d6e39b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:36.660545 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ff95249e-49a1-4316-835a-3bad86d6e39b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.163239 Aug 01 14:23:36.661130 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 201/398] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:36 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:37.266437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3db3e0f1-0269-4961-8e23-fd9d726ce528 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:37.267179 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3db3e0f1-0269-4961-8e23-fd9d726ce528 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:37.274096 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3db3e0f1-0269-4961-8e23-fd9d726ce528 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:37.274502 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3db3e0f1-0269-4961-8e23-fd9d726ce528 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:37.275264 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3db3e0f1-0269-4961-8e23-fd9d726ce528 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:37.275703 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3db3e0f1-0269-4961-8e23-fd9d726ce528 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:37.364986 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f8f842aa-e4cd-4e65-a8dc-d495f49098bf tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4acfc66-9960-4ceb-bb4a-a797ac3269e2", "device": "/dev/sdb"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:37.368753 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f8f842aa-e4cd-4e65-a8dc-d495f49098bf tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:37.375396 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f8f842aa-e4cd-4e65-a8dc-d495f49098bf tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:37.375847 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f8f842aa-e4cd-4e65-a8dc-d495f49098bf tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:37.376615 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f8f842aa-e4cd-4e65-a8dc-d495f49098bf tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:37.377042 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f8f842aa-e4cd-4e65-a8dc-d495f49098bf tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:37.431787 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3db3e0f1-0269-4961-8e23-fd9d726ce528 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:37.440102 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3db3e0f1-0269-4961-8e23-fd9d726ce528 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:37.441613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3db3e0f1-0269-4961-8e23-fd9d726ce528 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:37.442787 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3db3e0f1-0269-4961-8e23-fd9d726ce528 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1722 microversion: 2.20 time: 0.180681 Aug 01 14:23:37.444052 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 198/399] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:37 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:37.449017 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7e0c492f-a9f2-4a7b-b1e4-3d60e076095c tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:37.449624 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7e0c492f-a9f2-4a7b-b1e4-3d60e076095c tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:37.455839 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7e0c492f-a9f2-4a7b-b1e4-3d60e076095c tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:37.456324 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7e0c492f-a9f2-4a7b-b1e4-3d60e076095c tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:37.457090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7e0c492f-a9f2-4a7b-b1e4-3d60e076095c tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:37.457526 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7e0c492f-a9f2-4a7b-b1e4-3d60e076095c tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:37.588207 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7e0c492f-a9f2-4a7b-b1e4-3d60e076095c tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:37.595570 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7e0c492f-a9f2-4a7b-b1e4-3d60e076095c tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1315 microversion: 2.1 time: 0.150107 Aug 01 14:23:37.596133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 199/400] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:37 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:37.682333 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ddc55d21-86de-4359-aeef-45023233e566 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:37.682904 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ddc55d21-86de-4359-aeef-45023233e566 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:37.688818 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ddc55d21-86de-4359-aeef-45023233e566 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:37.689270 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ddc55d21-86de-4359-aeef-45023233e566 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:37.690064 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ddc55d21-86de-4359-aeef-45023233e566 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:37.690534 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ddc55d21-86de-4359-aeef-45023233e566 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:37.828529 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ddc55d21-86de-4359-aeef-45023233e566 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:37.837210 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ddc55d21-86de-4359-aeef-45023233e566 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.159614 Aug 01 14:23:37.837782 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 200/401] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:37 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:38.466757 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6aed957b-322c-49d5-8a9c-8dfd1bd69c84 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:38.467541 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-6aed957b-322c-49d5-8a9c-8dfd1bd69c84 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:38.473937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6aed957b-322c-49d5-8a9c-8dfd1bd69c84 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:38.475418 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6aed957b-322c-49d5-8a9c-8dfd1bd69c84 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:38.476282 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6aed957b-322c-49d5-8a9c-8dfd1bd69c84 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:38.476921 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6aed957b-322c-49d5-8a9c-8dfd1bd69c84 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:38.613863 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6aed957b-322c-49d5-8a9c-8dfd1bd69c84 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:38.624316 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6aed957b-322c-49d5-8a9c-8dfd1bd69c84 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:38.626046 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6aed957b-322c-49d5-8a9c-8dfd1bd69c84 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:38.627214 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-6aed957b-322c-49d5-8a9c-8dfd1bd69c84 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1722 microversion: 2.20 time: 0.164696 Aug 01 14:23:38.635568 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 201/402] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:38 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:38.639613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-f28c5ac1-77f0-4f47-8a88-609e9496e72c req-7dcc78eb-e854-4253-95d9-3fc3f57fd8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff34e0e-c728-4ffb-8eba-169ede959890", "tag": "1e5c663d-f700-413f-aae1-9880c79000d4"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:38.649329 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-f28c5ac1-77f0-4f47-8a88-609e9496e72c req-7dcc78eb-e854-4253-95d9-3fc3f57fd8a6 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:38.649861 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-f28c5ac1-77f0-4f47-8a88-609e9496e72c req-7dcc78eb-e854-4253-95d9-3fc3f57fd8a6 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:38.660966 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-f28c5ac1-77f0-4f47-8a88-609e9496e72c req-7dcc78eb-e854-4253-95d9-3fc3f57fd8a6 service nova] Creating event network-changed:1e5c663d-f700-413f-aae1-9880c79000d4 for instance eff34e0e-c728-4ffb-8eba-169ede959890 on hv-cinder-78729 Aug 01 14:23:38.666421 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-f28c5ac1-77f0-4f47-8a88-609e9496e72c req-7dcc78eb-e854-4253-95d9-3fc3f57fd8a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037519 Aug 01 14:23:38.667052 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 202/403] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:23:38.672771 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-27a2f408-0575-4352-8032-0b31dba56af0 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:38.673669 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-27a2f408-0575-4352-8032-0b31dba56af0 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:38.680656 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-27a2f408-0575-4352-8032-0b31dba56af0 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:38.681109 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-27a2f408-0575-4352-8032-0b31dba56af0 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:38.681912 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-27a2f408-0575-4352-8032-0b31dba56af0 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:38.682352 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-27a2f408-0575-4352-8032-0b31dba56af0 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:38.813835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-27a2f408-0575-4352-8032-0b31dba56af0 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:38.823045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-27a2f408-0575-4352-8032-0b31dba56af0 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1315 microversion: 2.1 time: 0.154141 Aug 01 14:23:38.823648 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 203/404] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:38 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:38.858800 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-bcd3f14c-2617-478e-ae16-e331a5cd38b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:38.859413 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-bcd3f14c-2617-478e-ae16-e331a5cd38b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:38.866328 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bcd3f14c-2617-478e-ae16-e331a5cd38b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:38.866788 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bcd3f14c-2617-478e-ae16-e331a5cd38b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:38.867572 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bcd3f14c-2617-478e-ae16-e331a5cd38b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:38.868268 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bcd3f14c-2617-478e-ae16-e331a5cd38b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:39.022782 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bcd3f14c-2617-478e-ae16-e331a5cd38b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:39.030168 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-bcd3f14c-2617-478e-ae16-e331a5cd38b1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.175326 Aug 01 14:23:39.030728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 204/405] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:38 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:39.652044 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b215e866-bf12-438b-ae8b-c94888baaaff tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:39.652672 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b215e866-bf12-438b-ae8b-c94888baaaff tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:39.658766 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b215e866-bf12-438b-ae8b-c94888baaaff tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:39.659209 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b215e866-bf12-438b-ae8b-c94888baaaff tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:39.659962 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b215e866-bf12-438b-ae8b-c94888baaaff tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:39.660397 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b215e866-bf12-438b-ae8b-c94888baaaff tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:39.796194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b215e866-bf12-438b-ae8b-c94888baaaff tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:39.804836 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b215e866-bf12-438b-ae8b-c94888baaaff tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:39.806369 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b215e866-bf12-438b-ae8b-c94888baaaff tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:39.807519 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b215e866-bf12-438b-ae8b-c94888baaaff tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1722 microversion: 2.20 time: 0.159484 Aug 01 14:23:39.808076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 205/406] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:39 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:39.842210 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-676f68c8-a19e-4068-bed3-a8e262692b11 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:39.842820 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-676f68c8-a19e-4068-bed3-a8e262692b11 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:39.848653 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-676f68c8-a19e-4068-bed3-a8e262692b11 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:39.849104 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-676f68c8-a19e-4068-bed3-a8e262692b11 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:39.850105 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-676f68c8-a19e-4068-bed3-a8e262692b11 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:39.850551 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-676f68c8-a19e-4068-bed3-a8e262692b11 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:39.981248 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-676f68c8-a19e-4068-bed3-a8e262692b11 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:39.989789 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-676f68c8-a19e-4068-bed3-a8e262692b11 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1315 microversion: 2.1 time: 0.151076 Aug 01 14:23:39.990406 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 206/407] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:39 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:40.024511 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-d83b7dcd-5846-4c0e-ac3d-2fc3495c8dbd req-24abd027-c322-4e28-8d42-d5ea3817de40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c41c564-40f2-47cf-820b-915c3d43ccb3", "name": "network-vif-unplugged", "status": "completed", "tag": "bc816aff-9768-4c40-a6d1-adb40e9ce6a1"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:40.034194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-d83b7dcd-5846-4c0e-ac3d-2fc3495c8dbd req-24abd027-c322-4e28-8d42-d5ea3817de40 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:40.034628 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-d83b7dcd-5846-4c0e-ac3d-2fc3495c8dbd req-24abd027-c322-4e28-8d42-d5ea3817de40 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:40.045796 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-d83b7dcd-5846-4c0e-ac3d-2fc3495c8dbd req-24abd027-c322-4e28-8d42-d5ea3817de40 service nova] Creating event network-vif-unplugged:bc816aff-9768-4c40-a6d1-adb40e9ce6a1 for instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 on hv-cinder-78729 Aug 01 14:23:40.050710 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-d83b7dcd-5846-4c0e-ac3d-2fc3495c8dbd req-24abd027-c322-4e28-8d42-d5ea3817de40 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030757 Aug 01 14:23:40.051286 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 207/408] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:23:40.058856 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-28f36c4d-776c-41c9-b6d6-26a9af7bcbb2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:40.058856 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-28f36c4d-776c-41c9-b6d6-26a9af7bcbb2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:40.062923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-28f36c4d-776c-41c9-b6d6-26a9af7bcbb2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:40.063389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-28f36c4d-776c-41c9-b6d6-26a9af7bcbb2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:40.064166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-28f36c4d-776c-41c9-b6d6-26a9af7bcbb2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:40.064602 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-28f36c4d-776c-41c9-b6d6-26a9af7bcbb2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:40.192701 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-28f36c4d-776c-41c9-b6d6-26a9af7bcbb2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:40.200802 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-28f36c4d-776c-41c9-b6d6-26a9af7bcbb2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.148283 Aug 01 14:23:40.201363 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 208/409] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:40 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:40.830173 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f5134bcb-c5f2-4b59-8f93-48bf09279974 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:40.830794 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f5134bcb-c5f2-4b59-8f93-48bf09279974 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:40.836941 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f5134bcb-c5f2-4b59-8f93-48bf09279974 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:40.837393 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f5134bcb-c5f2-4b59-8f93-48bf09279974 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:40.838188 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f5134bcb-c5f2-4b59-8f93-48bf09279974 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:40.838629 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f5134bcb-c5f2-4b59-8f93-48bf09279974 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:40.981234 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f5134bcb-c5f2-4b59-8f93-48bf09279974 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:40.984638 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f5134bcb-c5f2-4b59-8f93-48bf09279974 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:40.986191 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f5134bcb-c5f2-4b59-8f93-48bf09279974 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:40.987342 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f5134bcb-c5f2-4b59-8f93-48bf09279974 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1722 microversion: 2.20 time: 0.161191 Aug 01 14:23:40.987933 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 209/410] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:40 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:41.011518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ffd8b5e3-e8b5-43da-b99c-ca52de3064b6 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:41.012164 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ffd8b5e3-e8b5-43da-b99c-ca52de3064b6 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:41.018614 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ffd8b5e3-e8b5-43da-b99c-ca52de3064b6 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.019010 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ffd8b5e3-e8b5-43da-b99c-ca52de3064b6 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.019781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ffd8b5e3-e8b5-43da-b99c-ca52de3064b6 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.020247 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ffd8b5e3-e8b5-43da-b99c-ca52de3064b6 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.151442 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ffd8b5e3-e8b5-43da-b99c-ca52de3064b6 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:41.155105 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=100 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:41.159769 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ffd8b5e3-e8b5-43da-b99c-ca52de3064b6 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1315 microversion: 2.1 time: 0.152039 Aug 01 14:23:41.160574 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 210/411] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:41 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:41.222834 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-69b31650-414b-4457-ba8f-b8676a297a58 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:41.223548 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-69b31650-414b-4457-ba8f-b8676a297a58 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:41.227204 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:41.230910 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-69b31650-414b-4457-ba8f-b8676a297a58 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.231364 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-69b31650-414b-4457-ba8f-b8676a297a58 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.236765 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-69b31650-414b-4457-ba8f-b8676a297a58 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:41.236765 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-69b31650-414b-4457-ba8f-b8676a297a58 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:41.380279 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-69b31650-414b-4457-ba8f-b8676a297a58 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:41.389876 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-69b31650-414b-4457-ba8f-b8676a297a58 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.171586 Aug 01 14:23:41.390788 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 211/412] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:41 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:41.861881 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f8f842aa-e4cd-4e65-a8dc-d495f49098bf tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "POST /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.500556 Aug 01 14:23:41.862602 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 202/413] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Aug 1 14:23:37 2022] POST /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5/os-volume_attachments => generated 194 bytes in 4502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:23:42.011082 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-68033194-fab6-4941-9b37-187de77fc183 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:42.012425 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-68033194-fab6-4941-9b37-187de77fc183 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:42.019525 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-68033194-fab6-4941-9b37-187de77fc183 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.019969 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-68033194-fab6-4941-9b37-187de77fc183 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.020741 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-68033194-fab6-4941-9b37-187de77fc183 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.021845 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-68033194-fab6-4941-9b37-187de77fc183 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.155517 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-68033194-fab6-4941-9b37-187de77fc183 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:42.163976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-68033194-fab6-4941-9b37-187de77fc183 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:42.165470 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-68033194-fab6-4941-9b37-187de77fc183 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:42.169857 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-68033194-fab6-4941-9b37-187de77fc183 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1725 microversion: 2.20 time: 0.159521 Aug 01 14:23:42.169857 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 212/414] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:42 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:42.181515 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b036cf20-c7cb-4cae-b3da-b48a6bec0753 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:42.182341 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b036cf20-c7cb-4cae-b3da-b48a6bec0753 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:42.189143 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b036cf20-c7cb-4cae-b3da-b48a6bec0753 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.189590 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b036cf20-c7cb-4cae-b3da-b48a6bec0753 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.190092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a47dc36a-cc2f-4cdf-85f0-91de6e5439c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad71f725-4305-44cc-9a03-cb739b938516"}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:42.190457 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b036cf20-c7cb-4cae-b3da-b48a6bec0753 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.190895 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b036cf20-c7cb-4cae-b3da-b48a6bec0753 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.192553 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a47dc36a-cc2f-4cdf-85f0-91de6e5439c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:42.199585 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a47dc36a-cc2f-4cdf-85f0-91de6e5439c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.200038 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a47dc36a-cc2f-4cdf-85f0-91de6e5439c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.200813 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a47dc36a-cc2f-4cdf-85f0-91de6e5439c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.204370 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a47dc36a-cc2f-4cdf-85f0-91de6e5439c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.335639 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-b036cf20-c7cb-4cae-b3da-b48a6bec0753 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:42.343021 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b036cf20-c7cb-4cae-b3da-b48a6bec0753 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1315 microversion: 2.1 time: 0.166425 Aug 01 14:23:42.343577 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 203/415] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:42 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:42.411688 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3a84b7a0-445d-4471-8d65-a9ce1ceb31f5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:42.412734 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3a84b7a0-445d-4471-8d65-a9ce1ceb31f5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:42.419257 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3a84b7a0-445d-4471-8d65-a9ce1ceb31f5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.419788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3a84b7a0-445d-4471-8d65-a9ce1ceb31f5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.420574 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3a84b7a0-445d-4471-8d65-a9ce1ceb31f5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:42.421020 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3a84b7a0-445d-4471-8d65-a9ce1ceb31f5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:42.549094 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3a84b7a0-445d-4471-8d65-a9ce1ceb31f5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:42.557636 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3a84b7a0-445d-4471-8d65-a9ce1ceb31f5 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.149934 Aug 01 14:23:42.558240 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 204/416] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:42 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:43.349415 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a47dc36a-cc2f-4cdf-85f0-91de6e5439c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "POST /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.163328 Aug 01 14:23:43.357846 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 213/417] 10.222.0.49 () {62 vars in 1364 bytes} [Mon Aug 1 14:23:42 2022] POST /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/os-volume_attachments => generated 188 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:23:43.364178 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-a6ca3c17-43ca-4542-9d25-f41af5e1595f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:43.364812 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-a6ca3c17-43ca-4542-9d25-f41af5e1595f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:43.374621 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a6ca3c17-43ca-4542-9d25-f41af5e1595f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:43.375082 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a6ca3c17-43ca-4542-9d25-f41af5e1595f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:43.375863 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a6ca3c17-43ca-4542-9d25-f41af5e1595f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:43.376301 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a6ca3c17-43ca-4542-9d25-f41af5e1595f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:43.524279 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-39ba808a-9a90-492d-8e9e-2e33ddb96e2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:43.525519 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-39ba808a-9a90-492d-8e9e-2e33ddb96e2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:43.532489 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-39ba808a-9a90-492d-8e9e-2e33ddb96e2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:43.532941 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-39ba808a-9a90-492d-8e9e-2e33ddb96e2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:43.533717 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-39ba808a-9a90-492d-8e9e-2e33ddb96e2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:43.534363 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-39ba808a-9a90-492d-8e9e-2e33ddb96e2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:43.538319 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a6ca3c17-43ca-4542-9d25-f41af5e1595f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:43.546281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-a6ca3c17-43ca-4542-9d25-f41af5e1595f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1315 microversion: 2.1 time: 0.186533 Aug 01 14:23:43.549681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 205/418] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:43 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:43.578831 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-16306f96-0637-49ac-ba31-427814909320 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:43.579477 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-16306f96-0637-49ac-ba31-427814909320 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:43.582966 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-39ba808a-9a90-492d-8e9e-2e33ddb96e2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118247) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 14:23:43.586112 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-16306f96-0637-49ac-ba31-427814909320 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:43.586606 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-16306f96-0637-49ac-ba31-427814909320 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:43.587340 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-16306f96-0637-49ac-ba31-427814909320 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:43.587780 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-16306f96-0637-49ac-ba31-427814909320 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:43.606053 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:43.733337 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-16306f96-0637-49ac-ba31-427814909320 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:43.741525 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-16306f96-0637-49ac-ba31-427814909320 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.166471 Aug 01 14:23:43.744275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 206/419] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:43 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:43.917864 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-39ba808a-9a90-492d-8e9e-2e33ddb96e2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "POST /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/action" status: 202 len: 0 microversion: 2.20 time: 0.398667 Aug 01 14:23:43.918489 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 214/420] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Aug 1 14:23:43 2022] POST /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:23:43.926922 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-095604b7-8508-46c4-9d91-f529c3b58bfc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:43.928228 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-095604b7-8508-46c4-9d91-f529c3b58bfc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:43.935119 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-095604b7-8508-46c4-9d91-f529c3b58bfc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:43.935568 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-095604b7-8508-46c4-9d91-f529c3b58bfc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:43.936334 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-095604b7-8508-46c4-9d91-f529c3b58bfc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:43.936766 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-095604b7-8508-46c4-9d91-f529c3b58bfc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:44.081145 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-095604b7-8508-46c4-9d91-f529c3b58bfc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:44.089825 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-095604b7-8508-46c4-9d91-f529c3b58bfc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:44.091344 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-095604b7-8508-46c4-9d91-f529c3b58bfc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:44.092550 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-095604b7-8508-46c4-9d91-f529c3b58bfc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1751 microversion: 2.20 time: 0.169854 Aug 01 14:23:44.093109 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 207/421] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:43 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:44.571716 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-de33cc63-10c6-4b16-be46-22ac56c55a87 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:44.572443 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-de33cc63-10c6-4b16-be46-22ac56c55a87 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:44.578664 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-de33cc63-10c6-4b16-be46-22ac56c55a87 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:44.579195 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-de33cc63-10c6-4b16-be46-22ac56c55a87 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:44.580092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-de33cc63-10c6-4b16-be46-22ac56c55a87 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:44.580647 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-de33cc63-10c6-4b16-be46-22ac56c55a87 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:44.743842 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-de33cc63-10c6-4b16-be46-22ac56c55a87 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:44.751837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-de33cc63-10c6-4b16-be46-22ac56c55a87 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1315 microversion: 2.1 time: 0.185977 Aug 01 14:23:44.752402 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 215/422] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:44 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:44.763444 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-fe4a8d53-de22-4ea7-b39d-727bc43817fc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:44.765021 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-fe4a8d53-de22-4ea7-b39d-727bc43817fc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:44.774462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fe4a8d53-de22-4ea7-b39d-727bc43817fc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:44.775268 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fe4a8d53-de22-4ea7-b39d-727bc43817fc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:44.776245 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fe4a8d53-de22-4ea7-b39d-727bc43817fc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:44.776894 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fe4a8d53-de22-4ea7-b39d-727bc43817fc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:45.116544 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-01e3b22f-f8af-43dd-9d62-30a24d655d96 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:45.117156 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-01e3b22f-f8af-43dd-9d62-30a24d655d96 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:45.123726 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-01e3b22f-f8af-43dd-9d62-30a24d655d96 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:45.124170 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-01e3b22f-f8af-43dd-9d62-30a24d655d96 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:45.125101 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-01e3b22f-f8af-43dd-9d62-30a24d655d96 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:45.125850 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-01e3b22f-f8af-43dd-9d62-30a24d655d96 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:45.189481 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-fe4a8d53-de22-4ea7-b39d-727bc43817fc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:45.198357 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-fe4a8d53-de22-4ea7-b39d-727bc43817fc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.438812 Aug 01 14:23:45.202181 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 208/423] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:44 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:45.277043 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-01e3b22f-f8af-43dd-9d62-30a24d655d96 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:45.286372 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-01e3b22f-f8af-43dd-9d62-30a24d655d96 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:45.288010 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-01e3b22f-f8af-43dd-9d62-30a24d655d96 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:45.289193 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-01e3b22f-f8af-43dd-9d62-30a24d655d96 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1751 microversion: 2.20 time: 0.177463 Aug 01 14:23:45.289777 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 216/424] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:45 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:45.774113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-580ee617-2068-4497-b21a-e13169a05263 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:45.774842 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-580ee617-2068-4497-b21a-e13169a05263 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:45.782252 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-580ee617-2068-4497-b21a-e13169a05263 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:45.782878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-580ee617-2068-4497-b21a-e13169a05263 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:45.783696 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-580ee617-2068-4497-b21a-e13169a05263 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:45.784140 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-580ee617-2068-4497-b21a-e13169a05263 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:45.915838 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-580ee617-2068-4497-b21a-e13169a05263 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:45.923310 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-580ee617-2068-4497-b21a-e13169a05263 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1315 microversion: 2.1 time: 0.153610 Aug 01 14:23:45.923870 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 209/425] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:45 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:46.219649 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1ae6b48a-7fa6-4e36-abbf-3e44daba77c2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:46.220255 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1ae6b48a-7fa6-4e36-abbf-3e44daba77c2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:46.226385 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1ae6b48a-7fa6-4e36-abbf-3e44daba77c2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:46.226834 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1ae6b48a-7fa6-4e36-abbf-3e44daba77c2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:46.227603 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1ae6b48a-7fa6-4e36-abbf-3e44daba77c2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:46.228041 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1ae6b48a-7fa6-4e36-abbf-3e44daba77c2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:46.312378 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-14be6cfc-6ed6-4712-a549-44d1fc70b0ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:46.315053 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-14be6cfc-6ed6-4712-a549-44d1fc70b0ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:46.324337 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-14be6cfc-6ed6-4712-a549-44d1fc70b0ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:46.324337 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-14be6cfc-6ed6-4712-a549-44d1fc70b0ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:46.324337 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-14be6cfc-6ed6-4712-a549-44d1fc70b0ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:46.324337 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-14be6cfc-6ed6-4712-a549-44d1fc70b0ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:46.371514 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1ae6b48a-7fa6-4e36-abbf-3e44daba77c2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:46.379035 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1ae6b48a-7fa6-4e36-abbf-3e44daba77c2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.163370 Aug 01 14:23:46.379605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 217/426] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:46 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:46.454358 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-14be6cfc-6ed6-4712-a549-44d1fc70b0ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:46.463025 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-14be6cfc-6ed6-4712-a549-44d1fc70b0ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:46.464522 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-14be6cfc-6ed6-4712-a549-44d1fc70b0ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:46.465706 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-14be6cfc-6ed6-4712-a549-44d1fc70b0ac tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1753 microversion: 2.20 time: 0.157239 Aug 01 14:23:46.466279 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 210/427] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:46 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:46.944489 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-22b8a9a2-bb68-4c8b-bbbc-8420ee098429 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:46.945117 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-22b8a9a2-bb68-4c8b-bbbc-8420ee098429 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:46.951216 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-22b8a9a2-bb68-4c8b-bbbc-8420ee098429 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:46.951665 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-22b8a9a2-bb68-4c8b-bbbc-8420ee098429 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:46.952436 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-22b8a9a2-bb68-4c8b-bbbc-8420ee098429 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:46.952984 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-22b8a9a2-bb68-4c8b-bbbc-8420ee098429 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.089310 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-22b8a9a2-bb68-4c8b-bbbc-8420ee098429 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:47.096788 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-22b8a9a2-bb68-4c8b-bbbc-8420ee098429 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1315 microversion: 2.1 time: 0.156178 Aug 01 14:23:47.097360 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 218/428] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:46 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:47.200051 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-acc3e191-ba9d-47ca-92e8-7516c9ee2fe8 req-f6dbef9b-24f4-426e-92d3-652936ede854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32204f28-6a74-4eb5-acb0-29332869a35c", "name": "network-vif-plugged", "status": "completed", "tag": "f1925ba6-b627-4786-bebc-1d0f995e5cfa"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:47.206855 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:47.211017 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-acc3e191-ba9d-47ca-92e8-7516c9ee2fe8 req-f6dbef9b-24f4-426e-92d3-652936ede854 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.211530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-acc3e191-ba9d-47ca-92e8-7516c9ee2fe8 req-f6dbef9b-24f4-426e-92d3-652936ede854 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.223491 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-acc3e191-ba9d-47ca-92e8-7516c9ee2fe8 req-f6dbef9b-24f4-426e-92d3-652936ede854 service nova] Creating event network-vif-plugged:f1925ba6-b627-4786-bebc-1d0f995e5cfa for instance 32204f28-6a74-4eb5-acb0-29332869a35c on hv-cinder-78729 Aug 01 14:23:47.229579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-acc3e191-ba9d-47ca-92e8-7516c9ee2fe8 req-f6dbef9b-24f4-426e-92d3-652936ede854 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032734 Aug 01 14:23:47.229989 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 211/429] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:23:47.401091 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ed40579b-15de-48be-a5eb-906e222e62d0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:47.401703 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ed40579b-15de-48be-a5eb-906e222e62d0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:47.408302 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ed40579b-15de-48be-a5eb-906e222e62d0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.408900 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ed40579b-15de-48be-a5eb-906e222e62d0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.409741 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ed40579b-15de-48be-a5eb-906e222e62d0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.410211 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ed40579b-15de-48be-a5eb-906e222e62d0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.490176 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-fd67d7cd-b820-4487-b97f-7246f9f16bca tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:47.491400 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-fd67d7cd-b820-4487-b97f-7246f9f16bca tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:47.498259 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fd67d7cd-b820-4487-b97f-7246f9f16bca tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.498707 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fd67d7cd-b820-4487-b97f-7246f9f16bca tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.499475 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fd67d7cd-b820-4487-b97f-7246f9f16bca tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:47.499903 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fd67d7cd-b820-4487-b97f-7246f9f16bca tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:47.553045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ed40579b-15de-48be-a5eb-906e222e62d0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:47.561798 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ed40579b-15de-48be-a5eb-906e222e62d0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.164195 Aug 01 14:23:47.573779 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 219/430] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:47 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:47.647581 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-fd67d7cd-b820-4487-b97f-7246f9f16bca tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:47.657003 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-fd67d7cd-b820-4487-b97f-7246f9f16bca tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:47.658628 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-fd67d7cd-b820-4487-b97f-7246f9f16bca tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:47.659784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-fd67d7cd-b820-4487-b97f-7246f9f16bca tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1753 microversion: 2.20 time: 0.174598 Aug 01 14:23:47.660377 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 212/431] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:47 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:48.117582 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ff324792-f7bb-40b4-b466-9631a89221f0 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:48.118498 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ff324792-f7bb-40b4-b466-9631a89221f0 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:48.124611 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ff324792-f7bb-40b4-b466-9631a89221f0 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:48.125060 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ff324792-f7bb-40b4-b466-9631a89221f0 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:48.125861 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ff324792-f7bb-40b4-b466-9631a89221f0 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:48.126303 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ff324792-f7bb-40b4-b466-9631a89221f0 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:48.257026 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ff324792-f7bb-40b4-b466-9631a89221f0 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:48.266169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ff324792-f7bb-40b4-b466-9631a89221f0 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1315 microversion: 2.1 time: 0.152617 Aug 01 14:23:48.266747 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 220/432] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:48 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:48.584983 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-892cfef7-e06c-4e92-b44f-8262e514d3f8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:48.589992 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-892cfef7-e06c-4e92-b44f-8262e514d3f8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:48.592082 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-892cfef7-e06c-4e92-b44f-8262e514d3f8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:48.592532 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-892cfef7-e06c-4e92-b44f-8262e514d3f8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:48.593300 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-892cfef7-e06c-4e92-b44f-8262e514d3f8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:48.593746 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-892cfef7-e06c-4e92-b44f-8262e514d3f8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:48.683764 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-dc1a8a4f-f943-418e-a132-f05a356a2b33 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:48.684494 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-dc1a8a4f-f943-418e-a132-f05a356a2b33 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:48.690945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dc1a8a4f-f943-418e-a132-f05a356a2b33 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:48.691401 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dc1a8a4f-f943-418e-a132-f05a356a2b33 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:48.692176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dc1a8a4f-f943-418e-a132-f05a356a2b33 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:48.692629 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dc1a8a4f-f943-418e-a132-f05a356a2b33 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:48.774753 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-892cfef7-e06c-4e92-b44f-8262e514d3f8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:48.791254 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-892cfef7-e06c-4e92-b44f-8262e514d3f8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.210536 Aug 01 14:23:48.791850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 213/433] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:48 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:48.844077 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-dc1a8a4f-f943-418e-a132-f05a356a2b33 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:48.853559 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-dc1a8a4f-f943-418e-a132-f05a356a2b33 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:48.855098 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-dc1a8a4f-f943-418e-a132-f05a356a2b33 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:48.856252 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-dc1a8a4f-f943-418e-a132-f05a356a2b33 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1753 microversion: 2.20 time: 0.176409 Aug 01 14:23:48.856816 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 221/434] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:48 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:49.245995 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-f47dc74b-fc7b-4319-af65-ac51b33e0d61 req-896fa53a-3325-4c9e-a576-b9304bb9e6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff34e0e-c728-4ffb-8eba-169ede959890", "name": "network-vif-plugged", "status": "completed", "tag": "1e5c663d-f700-413f-aae1-9880c79000d4"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:49.256013 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-f47dc74b-fc7b-4319-af65-ac51b33e0d61 req-896fa53a-3325-4c9e-a576-b9304bb9e6f9 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:49.256463 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-f47dc74b-fc7b-4319-af65-ac51b33e0d61 req-896fa53a-3325-4c9e-a576-b9304bb9e6f9 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:49.267582 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-f47dc74b-fc7b-4319-af65-ac51b33e0d61 req-896fa53a-3325-4c9e-a576-b9304bb9e6f9 service nova] Creating event network-vif-plugged:1e5c663d-f700-413f-aae1-9880c79000d4 for instance eff34e0e-c728-4ffb-8eba-169ede959890 on hv-cinder-78729 Aug 01 14:23:49.273096 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-f47dc74b-fc7b-4319-af65-ac51b33e0d61 req-896fa53a-3325-4c9e-a576-b9304bb9e6f9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031148 Aug 01 14:23:49.273674 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 214/435] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:23:49.286516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ce86c03b-e6ac-4065-9d5d-7edb2b8eb60f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:49.287244 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ce86c03b-e6ac-4065-9d5d-7edb2b8eb60f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:49.293461 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ce86c03b-e6ac-4065-9d5d-7edb2b8eb60f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:49.293958 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ce86c03b-e6ac-4065-9d5d-7edb2b8eb60f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:49.294722 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ce86c03b-e6ac-4065-9d5d-7edb2b8eb60f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:49.295161 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ce86c03b-e6ac-4065-9d5d-7edb2b8eb60f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:49.435271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ce86c03b-e6ac-4065-9d5d-7edb2b8eb60f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:49.444291 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ce86c03b-e6ac-4065-9d5d-7edb2b8eb60f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1315 microversion: 2.1 time: 0.160366 Aug 01 14:23:49.445179 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 222/436] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:49 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:49.815747 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f26e105c-a861-4a8f-8230-d3e958331fd8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:49.816822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f26e105c-a861-4a8f-8230-d3e958331fd8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:49.824270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f26e105c-a861-4a8f-8230-d3e958331fd8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:49.824717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f26e105c-a861-4a8f-8230-d3e958331fd8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:49.825484 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f26e105c-a861-4a8f-8230-d3e958331fd8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:49.825962 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f26e105c-a861-4a8f-8230-d3e958331fd8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:49.884114 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-41c36dc0-7aa0-4021-8402-8d5a7d81d2ea tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:49.886332 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-41c36dc0-7aa0-4021-8402-8d5a7d81d2ea tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:49.895027 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-41c36dc0-7aa0-4021-8402-8d5a7d81d2ea tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:49.895536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-41c36dc0-7aa0-4021-8402-8d5a7d81d2ea tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:49.896335 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-41c36dc0-7aa0-4021-8402-8d5a7d81d2ea tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:49.896793 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-41c36dc0-7aa0-4021-8402-8d5a7d81d2ea tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:50.005519 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f26e105c-a861-4a8f-8230-d3e958331fd8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:50.014247 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f26e105c-a861-4a8f-8230-d3e958331fd8 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.205451 Aug 01 14:23:50.014821 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 215/437] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:49 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:50.059718 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-41c36dc0-7aa0-4021-8402-8d5a7d81d2ea tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:50.063210 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:50.068651 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-41c36dc0-7aa0-4021-8402-8d5a7d81d2ea tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:50.070195 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-41c36dc0-7aa0-4021-8402-8d5a7d81d2ea tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:50.071355 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-41c36dc0-7aa0-4021-8402-8d5a7d81d2ea tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1753 microversion: 2.20 time: 0.194745 Aug 01 14:23:50.073998 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 223/438] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:49 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1753 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:23:50.464412 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-06e69405-f54b-441e-820c-3044bcd48e29 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:50.465045 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-06e69405-f54b-441e-820c-3044bcd48e29 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:50.471179 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-06e69405-f54b-441e-820c-3044bcd48e29 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:50.471630 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-06e69405-f54b-441e-820c-3044bcd48e29 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:50.472403 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-06e69405-f54b-441e-820c-3044bcd48e29 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:50.472840 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-06e69405-f54b-441e-820c-3044bcd48e29 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:50.607061 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-06e69405-f54b-441e-820c-3044bcd48e29 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:50.614560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-06e69405-f54b-441e-820c-3044bcd48e29 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1465 microversion: 2.1 time: 0.153985 Aug 01 14:23:50.615268 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 216/439] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:50 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:50.663326 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7f2a538d-c02b-43c6-98ef-b47d44d27468 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:50.663821 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7f2a538d-c02b-43c6-98ef-b47d44d27468 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:50.670553 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7f2a538d-c02b-43c6-98ef-b47d44d27468 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:50.670997 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7f2a538d-c02b-43c6-98ef-b47d44d27468 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:50.671757 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7f2a538d-c02b-43c6-98ef-b47d44d27468 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:50.672187 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7f2a538d-c02b-43c6-98ef-b47d44d27468 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:50.699533 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7f2a538d-c02b-43c6-98ef-b47d44d27468 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Going to try to terminate instance {{(pid=118247) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:23:50.983756 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7f2a538d-c02b-43c6-98ef-b47d44d27468 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "DELETE /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 204 len: 0 microversion: 2.1 time: 0.325002 Aug 01 14:23:50.984408 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 224/440] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:23:50 2022] DELETE /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:23:50.992476 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8efe7250-9cd4-4900-bc01-26f5c1776f0a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:50.993353 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8efe7250-9cd4-4900-bc01-26f5c1776f0a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:51.000016 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8efe7250-9cd4-4900-bc01-26f5c1776f0a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:51.000472 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8efe7250-9cd4-4900-bc01-26f5c1776f0a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:51.001239 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8efe7250-9cd4-4900-bc01-26f5c1776f0a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:51.001679 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8efe7250-9cd4-4900-bc01-26f5c1776f0a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:51.036527 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-60ab5acd-281a-42ff-8b0c-699250f5309f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:51.038053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-60ab5acd-281a-42ff-8b0c-699250f5309f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:51.045002 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-60ab5acd-281a-42ff-8b0c-699250f5309f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:51.045456 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-60ab5acd-281a-42ff-8b0c-699250f5309f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:51.046318 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-60ab5acd-281a-42ff-8b0c-699250f5309f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:51.046793 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-60ab5acd-281a-42ff-8b0c-699250f5309f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:51.183803 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8efe7250-9cd4-4900-bc01-26f5c1776f0a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:51.191471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8efe7250-9cd4-4900-bc01-26f5c1776f0a tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1471 microversion: 2.1 time: 0.202850 Aug 01 14:23:51.192135 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 217/441] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:50 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1471 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:51.201267 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-a48c8f24-e780-4aad-a458-b7d791b91962 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:51.202056 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-a48c8f24-e780-4aad-a458-b7d791b91962 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:51.206844 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-60ab5acd-281a-42ff-8b0c-699250f5309f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:51.208002 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a48c8f24-e780-4aad-a458-b7d791b91962 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:51.208451 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a48c8f24-e780-4aad-a458-b7d791b91962 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:51.209638 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a48c8f24-e780-4aad-a458-b7d791b91962 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:51.210108 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a48c8f24-e780-4aad-a458-b7d791b91962 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:51.214889 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-60ab5acd-281a-42ff-8b0c-699250f5309f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.182590 Aug 01 14:23:51.215438 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 225/442] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:51 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:51.341962 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a48c8f24-e780-4aad-a458-b7d791b91962 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:51.351131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a48c8f24-e780-4aad-a458-b7d791b91962 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:51.352635 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a48c8f24-e780-4aad-a458-b7d791b91962 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:51.354099 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-a48c8f24-e780-4aad-a458-b7d791b91962 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1753 microversion: 2.20 time: 0.156252 Aug 01 14:23:51.354675 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 218/443] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:51 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:52.212992 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-19bb209f-f4f3-4c6a-bf90-4c7ec4f86b02 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:52.213603 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-19bb209f-f4f3-4c6a-bf90-4c7ec4f86b02 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:52.219630 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-19bb209f-f4f3-4c6a-bf90-4c7ec4f86b02 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:52.220080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-19bb209f-f4f3-4c6a-bf90-4c7ec4f86b02 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:52.220842 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-19bb209f-f4f3-4c6a-bf90-4c7ec4f86b02 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:52.221280 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-19bb209f-f4f3-4c6a-bf90-4c7ec4f86b02 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:52.236237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-55ef7dac-59fc-4f56-bc41-433ae2661bd3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:52.236926 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-55ef7dac-59fc-4f56-bc41-433ae2661bd3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:52.243946 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-55ef7dac-59fc-4f56-bc41-433ae2661bd3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:52.244401 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-55ef7dac-59fc-4f56-bc41-433ae2661bd3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:52.245162 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-55ef7dac-59fc-4f56-bc41-433ae2661bd3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:52.245598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-55ef7dac-59fc-4f56-bc41-433ae2661bd3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:52.419795 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-19bb209f-f4f3-4c6a-bf90-4c7ec4f86b02 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:52.427761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-19bb209f-f4f3-4c6a-bf90-4c7ec4f86b02 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1471 microversion: 2.1 time: 0.218702 Aug 01 14:23:52.428497 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 226/444] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:52 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:52.431826 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-55ef7dac-59fc-4f56-bc41-433ae2661bd3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:52.432983 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-79b1ff2e-52dd-4e56-9dda-9f088ef63e20 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:52.433547 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-79b1ff2e-52dd-4e56-9dda-9f088ef63e20 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:52.439380 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-79b1ff2e-52dd-4e56-9dda-9f088ef63e20 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:52.439835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-79b1ff2e-52dd-4e56-9dda-9f088ef63e20 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:52.440609 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-79b1ff2e-52dd-4e56-9dda-9f088ef63e20 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:52.440771 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-55ef7dac-59fc-4f56-bc41-433ae2661bd3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.208352 Aug 01 14:23:52.441052 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-79b1ff2e-52dd-4e56-9dda-9f088ef63e20 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:52.442290 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 219/445] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:52 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:52.576489 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-79b1ff2e-52dd-4e56-9dda-9f088ef63e20 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:52.585664 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-79b1ff2e-52dd-4e56-9dda-9f088ef63e20 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:52.587192 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-79b1ff2e-52dd-4e56-9dda-9f088ef63e20 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:52.588354 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-79b1ff2e-52dd-4e56-9dda-9f088ef63e20 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1753 microversion: 2.20 time: 0.158938 Aug 01 14:23:52.588908 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 227/446] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:52 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:53.475245 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c8673b0b-a6fc-4460-a269-33e412438b6b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:53.475845 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c8673b0b-a6fc-4460-a269-33e412438b6b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:53.482303 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c8673b0b-a6fc-4460-a269-33e412438b6b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:53.482752 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c8673b0b-a6fc-4460-a269-33e412438b6b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:53.483507 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c8673b0b-a6fc-4460-a269-33e412438b6b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:53.483941 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c8673b0b-a6fc-4460-a269-33e412438b6b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:53.510315 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-bf0bb800-496f-4449-856b-30edf11a4d5e tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:53.511025 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-bf0bb800-496f-4449-856b-30edf11a4d5e tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:53.517204 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bf0bb800-496f-4449-856b-30edf11a4d5e tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:53.517734 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bf0bb800-496f-4449-856b-30edf11a4d5e tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:53.518633 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bf0bb800-496f-4449-856b-30edf11a4d5e tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:53.519147 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bf0bb800-496f-4449-856b-30edf11a4d5e tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:53.680165 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c8673b0b-a6fc-4460-a269-33e412438b6b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:53.688512 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c8673b0b-a6fc-4460-a269-33e412438b6b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.217656 Aug 01 14:23:53.691400 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 220/447] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:53 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:53.695181 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f2a1f9d5-c492-424a-853b-196b4432dc25 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:53.695952 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f2a1f9d5-c492-424a-853b-196b4432dc25 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:53.703051 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2a1f9d5-c492-424a-853b-196b4432dc25 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:53.703695 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2a1f9d5-c492-424a-853b-196b4432dc25 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:53.704668 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2a1f9d5-c492-424a-853b-196b4432dc25 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:53.705193 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2a1f9d5-c492-424a-853b-196b4432dc25 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:53.709225 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bf0bb800-496f-4449-856b-30edf11a4d5e tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:53.718147 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-bf0bb800-496f-4449-856b-30edf11a4d5e tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1471 microversion: 2.1 time: 0.211675 Aug 01 14:23:53.718721 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 228/448] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:53 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1471 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:53.841974 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f2a1f9d5-c492-424a-853b-196b4432dc25 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:53.850703 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f2a1f9d5-c492-424a-853b-196b4432dc25 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:53.852199 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f2a1f9d5-c492-424a-853b-196b4432dc25 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:53.853353 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f2a1f9d5-c492-424a-853b-196b4432dc25 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1753 microversion: 2.20 time: 0.163227 Aug 01 14:23:53.853948 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 221/449] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:53 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:54.711768 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-869328e0-d48d-4467-b88f-9e4f3f1f58e0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:54.712387 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-869328e0-d48d-4467-b88f-9e4f3f1f58e0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:54.718483 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-869328e0-d48d-4467-b88f-9e4f3f1f58e0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:54.719145 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-869328e0-d48d-4467-b88f-9e4f3f1f58e0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:54.719975 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-869328e0-d48d-4467-b88f-9e4f3f1f58e0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:54.720419 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-869328e0-d48d-4467-b88f-9e4f3f1f58e0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:54.745599 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8ad61873-5ba4-44a0-9840-dec5c7633b95 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:54.746257 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8ad61873-5ba4-44a0-9840-dec5c7633b95 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:54.759549 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8ad61873-5ba4-44a0-9840-dec5c7633b95 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:54.760605 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8ad61873-5ba4-44a0-9840-dec5c7633b95 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:54.762058 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8ad61873-5ba4-44a0-9840-dec5c7633b95 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:54.763208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8ad61873-5ba4-44a0-9840-dec5c7633b95 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:54.951835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-869328e0-d48d-4467-b88f-9e4f3f1f58e0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:54.951960 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8ad61873-5ba4-44a0-9840-dec5c7633b95 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:54.955999 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-869328e0-d48d-4467-b88f-9e4f3f1f58e0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.248484 Aug 01 14:23:54.956569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 229/450] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:54 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:54.961808 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8ad61873-5ba4-44a0-9840-dec5c7633b95 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1471 microversion: 2.1 time: 0.220556 Aug 01 14:23:54.962709 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 222/451] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:54 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1471 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:54.980968 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-129ec805-7066-4b47-8179-e0ecb2f5bed3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:54.981770 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-129ec805-7066-4b47-8179-e0ecb2f5bed3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:54.988007 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-129ec805-7066-4b47-8179-e0ecb2f5bed3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:54.988455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-129ec805-7066-4b47-8179-e0ecb2f5bed3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:54.989227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-129ec805-7066-4b47-8179-e0ecb2f5bed3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:54.989661 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-129ec805-7066-4b47-8179-e0ecb2f5bed3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:55.137964 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-129ec805-7066-4b47-8179-e0ecb2f5bed3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:55.142651 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-129ec805-7066-4b47-8179-e0ecb2f5bed3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:55.144143 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-129ec805-7066-4b47-8179-e0ecb2f5bed3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:55.145323 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-129ec805-7066-4b47-8179-e0ecb2f5bed3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1753 microversion: 2.20 time: 0.187565 Aug 01 14:23:55.145902 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 230/452] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:54 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:55.980667 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d0de3919-0626-41b1-b129-280075dea4cc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:55.981274 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d0de3919-0626-41b1-b129-280075dea4cc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:55.983172 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c0974b3e-6ed4-4c60-934d-55a0051e9a5b tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:55.983869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c0974b3e-6ed4-4c60-934d-55a0051e9a5b tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:55.987811 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d0de3919-0626-41b1-b129-280075dea4cc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:55.988266 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d0de3919-0626-41b1-b129-280075dea4cc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:55.989039 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d0de3919-0626-41b1-b129-280075dea4cc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:55.989480 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d0de3919-0626-41b1-b129-280075dea4cc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:55.990895 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c0974b3e-6ed4-4c60-934d-55a0051e9a5b tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:55.991359 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c0974b3e-6ed4-4c60-934d-55a0051e9a5b tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:55.992137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c0974b3e-6ed4-4c60-934d-55a0051e9a5b tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:55.992579 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c0974b3e-6ed4-4c60-934d-55a0051e9a5b tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:56.195668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c0974b3e-6ed4-4c60-934d-55a0051e9a5b tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:56.203368 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d0de3919-0626-41b1-b129-280075dea4cc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:56.205172 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c0974b3e-6ed4-4c60-934d-55a0051e9a5b tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1471 microversion: 2.1 time: 0.225876 Aug 01 14:23:56.213361 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 231/453] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:55 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1471 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:56.213361 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b7e70c6e-4767-4c8b-92a2-4ae76e78469f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:56.213361 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b7e70c6e-4767-4c8b-92a2-4ae76e78469f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:56.219572 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d0de3919-0626-41b1-b129-280075dea4cc tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.242668 Aug 01 14:23:56.225098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 223/454] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:55 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:56.225243 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b7e70c6e-4767-4c8b-92a2-4ae76e78469f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:56.225243 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b7e70c6e-4767-4c8b-92a2-4ae76e78469f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:56.226187 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b7e70c6e-4767-4c8b-92a2-4ae76e78469f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:56.226890 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b7e70c6e-4767-4c8b-92a2-4ae76e78469f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:56.360164 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b7e70c6e-4767-4c8b-92a2-4ae76e78469f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:56.369781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b7e70c6e-4767-4c8b-92a2-4ae76e78469f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:56.371558 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b7e70c6e-4767-4c8b-92a2-4ae76e78469f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:56.372716 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b7e70c6e-4767-4c8b-92a2-4ae76e78469f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1753 microversion: 2.20 time: 0.165468 Aug 01 14:23:56.373263 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 232/455] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:56 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:57.228907 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ffc3c061-c7d1-4892-91dc-3fafad93d126 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:57.229523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ffc3c061-c7d1-4892-91dc-3fafad93d126 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:57.236052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ffc3c061-c7d1-4892-91dc-3fafad93d126 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:57.236446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ffc3c061-c7d1-4892-91dc-3fafad93d126 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:57.237605 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ffc3c061-c7d1-4892-91dc-3fafad93d126 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:57.238067 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ffc3c061-c7d1-4892-91dc-3fafad93d126 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:57.243879 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-fce02f8d-db7f-4c59-b117-3eb5ec6a9afd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:57.245004 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-fce02f8d-db7f-4c59-b117-3eb5ec6a9afd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:57.251738 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fce02f8d-db7f-4c59-b117-3eb5ec6a9afd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:57.252306 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fce02f8d-db7f-4c59-b117-3eb5ec6a9afd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:57.253202 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fce02f8d-db7f-4c59-b117-3eb5ec6a9afd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:57.253738 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fce02f8d-db7f-4c59-b117-3eb5ec6a9afd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:57.257738 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=100 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:57.439065 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ffc3c061-c7d1-4892-91dc-3fafad93d126 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:57.446448 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-fce02f8d-db7f-4c59-b117-3eb5ec6a9afd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:57.448078 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ffc3c061-c7d1-4892-91dc-3fafad93d126 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1471 microversion: 2.1 time: 0.224278 Aug 01 14:23:57.448954 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 224/456] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:57 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1471 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:57.454351 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f06f69ab-4e88-41ee-b0c3-6dbc6de5dc58 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:57.455227 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f06f69ab-4e88-41ee-b0c3-6dbc6de5dc58 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:57.457145 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-fce02f8d-db7f-4c59-b117-3eb5ec6a9afd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.217394 Aug 01 14:23:57.462070 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f06f69ab-4e88-41ee-b0c3-6dbc6de5dc58 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:57.462776 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f06f69ab-4e88-41ee-b0c3-6dbc6de5dc58 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:57.463615 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f06f69ab-4e88-41ee-b0c3-6dbc6de5dc58 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:57.464054 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f06f69ab-4e88-41ee-b0c3-6dbc6de5dc58 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:57.464921 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 233/457] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:57 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:57.594057 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f06f69ab-4e88-41ee-b0c3-6dbc6de5dc58 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:57.602599 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f06f69ab-4e88-41ee-b0c3-6dbc6de5dc58 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:57.604100 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f06f69ab-4e88-41ee-b0c3-6dbc6de5dc58 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:57.605257 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f06f69ab-4e88-41ee-b0c3-6dbc6de5dc58 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1753 microversion: 2.20 time: 0.155111 Aug 01 14:23:57.605829 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 225/458] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:57 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:58.469877 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7d501184-17d8-4a3d-a6f6-a6f1e46c92ce tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:58.470667 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7d501184-17d8-4a3d-a6f6-a6f1e46c92ce tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:58.478262 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7d501184-17d8-4a3d-a6f6-a6f1e46c92ce tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:58.478715 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7d501184-17d8-4a3d-a6f6-a6f1e46c92ce tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:58.498078 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7d501184-17d8-4a3d-a6f6-a6f1e46c92ce tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:58.498078 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7d501184-17d8-4a3d-a6f6-a6f1e46c92ce tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:58.498364 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b9d70820-2ee4-46aa-ae1a-6bb9e7ed5331 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:58.498364 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b9d70820-2ee4-46aa-ae1a-6bb9e7ed5331 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:58.498364 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b9d70820-2ee4-46aa-ae1a-6bb9e7ed5331 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:58.498364 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b9d70820-2ee4-46aa-ae1a-6bb9e7ed5331 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:58.499082 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b9d70820-2ee4-46aa-ae1a-6bb9e7ed5331 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:58.499452 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b9d70820-2ee4-46aa-ae1a-6bb9e7ed5331 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:58.708833 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7d501184-17d8-4a3d-a6f6-a6f1e46c92ce tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:58.713537 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-b9d70820-2ee4-46aa-ae1a-6bb9e7ed5331 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:58.718809 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7d501184-17d8-4a3d-a6f6-a6f1e46c92ce tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1471 microversion: 2.1 time: 0.252501 Aug 01 14:23:58.718938 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 234/459] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:58 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1471 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:58.723050 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b9d70820-2ee4-46aa-ae1a-6bb9e7ed5331 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1370 microversion: 2.1 time: 0.239487 Aug 01 14:23:58.723682 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 226/460] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:58 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:58.737554 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6bcba1c4-46df-4c09-a31f-5203709c645c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:58.737554 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-6bcba1c4-46df-4c09-a31f-5203709c645c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:58.757153 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6bcba1c4-46df-4c09-a31f-5203709c645c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:58.757153 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6bcba1c4-46df-4c09-a31f-5203709c645c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:58.757153 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6bcba1c4-46df-4c09-a31f-5203709c645c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:58.757153 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6bcba1c4-46df-4c09-a31f-5203709c645c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:58.824715 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-40f6aec0-5052-4deb-94f9-b278a716c00e req-cb97375d-686d-4c8d-9c53-5d0a247f2ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32204f28-6a74-4eb5-acb0-29332869a35c", "name": "network-vif-deleted", "tag": "f1925ba6-b627-4786-bebc-1d0f995e5cfa"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:58.838811 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-40f6aec0-5052-4deb-94f9-b278a716c00e req-cb97375d-686d-4c8d-9c53-5d0a247f2ca6 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:58.839421 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-40f6aec0-5052-4deb-94f9-b278a716c00e req-cb97375d-686d-4c8d-9c53-5d0a247f2ca6 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:58.856495 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-40f6aec0-5052-4deb-94f9-b278a716c00e req-cb97375d-686d-4c8d-9c53-5d0a247f2ca6 service nova] Creating event network-vif-deleted:f1925ba6-b627-4786-bebc-1d0f995e5cfa for instance 32204f28-6a74-4eb5-acb0-29332869a35c on hv-cinder-78729 Aug 01 14:23:58.863462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-40f6aec0-5052-4deb-94f9-b278a716c00e req-cb97375d-686d-4c8d-9c53-5d0a247f2ca6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042708 Aug 01 14:23:58.864271 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 227/461] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:23:58.919191 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6bcba1c4-46df-4c09-a31f-5203709c645c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:58.928919 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6bcba1c4-46df-4c09-a31f-5203709c645c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:58.930506 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6bcba1c4-46df-4c09-a31f-5203709c645c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:58.931678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-6bcba1c4-46df-4c09-a31f-5203709c645c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1753 microversion: 2.20 time: 0.201890 Aug 01 14:23:58.932239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 235/462] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:58 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1753 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:23:59.745380 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3fd298b3-ebd6-4467-90d1-23eb332a207f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:59.746223 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3fd298b3-ebd6-4467-90d1-23eb332a207f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:59.749841 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4483dc24-5c4a-41f7-93e2-7a5555015150 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:59.753573 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-4483dc24-5c4a-41f7-93e2-7a5555015150 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:59.753736 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3fd298b3-ebd6-4467-90d1-23eb332a207f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:59.754113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3fd298b3-ebd6-4467-90d1-23eb332a207f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:59.754908 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3fd298b3-ebd6-4467-90d1-23eb332a207f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:59.756174 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3fd298b3-ebd6-4467-90d1-23eb332a207f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:59.757232 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4483dc24-5c4a-41f7-93e2-7a5555015150 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:59.757678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4483dc24-5c4a-41f7-93e2-7a5555015150 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:59.763568 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4483dc24-5c4a-41f7-93e2-7a5555015150 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:59.764015 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4483dc24-5c4a-41f7-93e2-7a5555015150 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:59.790301 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3fd298b3-ebd6-4467-90d1-23eb332a207f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:59.790672 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3fd298b3-ebd6-4467-90d1-23eb332a207f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:59.791127 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-3fd298b3-ebd6-4467-90d1-23eb332a207f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lazy-loading 'fault' on Instance uuid 32204f28-6a74-4eb5-acb0-29332869a35c {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:23:59.856884 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3fd298b3-ebd6-4467-90d1-23eb332a207f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:59.864408 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3fd298b3-ebd6-4467-90d1-23eb332a207f tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1305 microversion: 2.1 time: 0.123755 Aug 01 14:23:59.865639 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 228/463] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:59 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1305 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:59.920613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4483dc24-5c4a-41f7-93e2-7a5555015150 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:59.928558 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4483dc24-5c4a-41f7-93e2-7a5555015150 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1565 microversion: 2.1 time: 0.182842 Aug 01 14:23:59.929110 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 236/464] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:59 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:23:59.949845 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0a576d8c-9ea3-4b90-9ce1-af67992668df tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:59.950348 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0a576d8c-9ea3-4b90-9ce1-af67992668df tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:59.958220 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-fca40bd6-f716-4b97-8209-a75475aa0d42 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:59.958596 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0a576d8c-9ea3-4b90-9ce1-af67992668df tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:59.959361 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-fca40bd6-f716-4b97-8209-a75475aa0d42 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:59.959775 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0a576d8c-9ea3-4b90-9ce1-af67992668df tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:59.960962 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0a576d8c-9ea3-4b90-9ce1-af67992668df tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:59.961664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0a576d8c-9ea3-4b90-9ce1-af67992668df tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:59.966526 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fca40bd6-f716-4b97-8209-a75475aa0d42 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:59.967227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fca40bd6-f716-4b97-8209-a75475aa0d42 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:59.968223 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fca40bd6-f716-4b97-8209-a75475aa0d42 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:59.968822 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fca40bd6-f716-4b97-8209-a75475aa0d42 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:00.078162 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0a576d8c-9ea3-4b90-9ce1-af67992668df tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132118 Aug 01 14:24:00.078847 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 229/465] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Aug 1 14:23:59 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:00.142879 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-fca40bd6-f716-4b97-8209-a75475aa0d42 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:00.152897 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-fca40bd6-f716-4b97-8209-a75475aa0d42 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:00.154465 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-fca40bd6-f716-4b97-8209-a75475aa0d42 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:00.156447 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-fca40bd6-f716-4b97-8209-a75475aa0d42 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1753 microversion: 2.20 time: 0.201579 Aug 01 14:24:00.156447 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 237/466] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:23:59 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1753 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:00.887903 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-65d55067-cc4a-47ff-892a-40849eb91c23 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:00.888500 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-65d55067-cc4a-47ff-892a-40849eb91c23 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:00.894677 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-65d55067-cc4a-47ff-892a-40849eb91c23 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:00.895124 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-65d55067-cc4a-47ff-892a-40849eb91c23 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:00.895885 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-65d55067-cc4a-47ff-892a-40849eb91c23 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:00.896327 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-65d55067-cc4a-47ff-892a-40849eb91c23 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:00.929337 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-65d55067-cc4a-47ff-892a-40849eb91c23 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:00.929818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-65d55067-cc4a-47ff-892a-40849eb91c23 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:00.930277 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-65d55067-cc4a-47ff-892a-40849eb91c23 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lazy-loading 'fault' on Instance uuid 32204f28-6a74-4eb5-acb0-29332869a35c {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:24:00.970410 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-65d55067-cc4a-47ff-892a-40849eb91c23 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:00.978588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-65d55067-cc4a-47ff-892a-40849eb91c23 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1305 microversion: 2.1 time: 0.095044 Aug 01 14:24:00.979225 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 230/467] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:00 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:01.004126 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:24:01.004379 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Mon Aug 1 14:24:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:24:01.178811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4827baf8-a86d-47ae-b404-fb1331e3800f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:01.179438 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-4827baf8-a86d-47ae-b404-fb1331e3800f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:01.185587 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4827baf8-a86d-47ae-b404-fb1331e3800f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:01.186065 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4827baf8-a86d-47ae-b404-fb1331e3800f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:01.186825 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4827baf8-a86d-47ae-b404-fb1331e3800f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:01.187254 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4827baf8-a86d-47ae-b404-fb1331e3800f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:01.314507 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-cf344576-f616-4ba2-be20-ee840e78aff2 req-9e86154c-e58a-4020-9fdf-cc6ad2874020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff34e0e-c728-4ffb-8eba-169ede959890", "tag": "1e5c663d-f700-413f-aae1-9880c79000d4"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:01.325475 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-cf344576-f616-4ba2-be20-ee840e78aff2 req-9e86154c-e58a-4020-9fdf-cc6ad2874020 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:01.325984 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4827baf8-a86d-47ae-b404-fb1331e3800f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:01.326360 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-cf344576-f616-4ba2-be20-ee840e78aff2 req-9e86154c-e58a-4020-9fdf-cc6ad2874020 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:01.329907 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:01.336019 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4827baf8-a86d-47ae-b404-fb1331e3800f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:01.337572 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4827baf8-a86d-47ae-b404-fb1331e3800f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:01.341516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4827baf8-a86d-47ae-b404-fb1331e3800f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1753 microversion: 2.20 time: 0.164078 Aug 01 14:24:01.341516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 238/468] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:01 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:01.341734 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-cf344576-f616-4ba2-be20-ee840e78aff2 req-9e86154c-e58a-4020-9fdf-cc6ad2874020 service nova] Creating event network-changed:1e5c663d-f700-413f-aae1-9880c79000d4 for instance eff34e0e-c728-4ffb-8eba-169ede959890 on hv-cinder-78729 Aug 01 14:24:01.345009 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-cf344576-f616-4ba2-be20-ee840e78aff2 req-9e86154c-e58a-4020-9fdf-cc6ad2874020 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034294 Aug 01 14:24:01.345973 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 231/469] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:02.000460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d16b382a-045d-4c5b-ae54-efa60328f758 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:02.001088 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d16b382a-045d-4c5b-ae54-efa60328f758 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:02.008593 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d16b382a-045d-4c5b-ae54-efa60328f758 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:02.009037 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d16b382a-045d-4c5b-ae54-efa60328f758 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:02.009824 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d16b382a-045d-4c5b-ae54-efa60328f758 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:02.010258 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d16b382a-045d-4c5b-ae54-efa60328f758 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:02.042591 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d16b382a-045d-4c5b-ae54-efa60328f758 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:02.042956 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d16b382a-045d-4c5b-ae54-efa60328f758 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:02.043418 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-d16b382a-045d-4c5b-ae54-efa60328f758 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lazy-loading 'fault' on Instance uuid 32204f28-6a74-4eb5-acb0-29332869a35c {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:24:02.086651 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d16b382a-045d-4c5b-ae54-efa60328f758 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca8ccda749c4254bc186598e1f645c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f19c17b2ebe4eb9bf21ea3440988401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:02.094024 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d16b382a-045d-4c5b-ae54-efa60328f758 tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 200 len: 1305 microversion: 2.1 time: 0.097732 Aug 01 14:24:02.094583 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 239/470] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:01 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:02.375461 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7ed5c9dd-8949-4011-97ec-33adbaa25b2b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:02.377298 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7ed5c9dd-8949-4011-97ec-33adbaa25b2b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:02.386802 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7ed5c9dd-8949-4011-97ec-33adbaa25b2b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:02.387327 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7ed5c9dd-8949-4011-97ec-33adbaa25b2b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:02.388546 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7ed5c9dd-8949-4011-97ec-33adbaa25b2b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:02.389080 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7ed5c9dd-8949-4011-97ec-33adbaa25b2b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:02.540721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7ed5c9dd-8949-4011-97ec-33adbaa25b2b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:02.550082 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7ed5c9dd-8949-4011-97ec-33adbaa25b2b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:02.551505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7ed5c9dd-8949-4011-97ec-33adbaa25b2b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:02.553312 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7ed5c9dd-8949-4011-97ec-33adbaa25b2b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1753 microversion: 2.20 time: 0.193699 Aug 01 14:24:02.553897 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 232/471] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:02 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1753 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:03.114986 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-aeb58f48-7712-48b4-9afa-ec9a7b03c1bc tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:03.115603 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-aeb58f48-7712-48b4-9afa-ec9a7b03c1bc tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] [instance: 32204f28-6a74-4eb5-acb0-29332869a35c] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:03.121988 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-aeb58f48-7712-48b4-9afa-ec9a7b03c1bc tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:03.122442 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-aeb58f48-7712-48b4-9afa-ec9a7b03c1bc tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:03.123211 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-aeb58f48-7712-48b4-9afa-ec9a7b03c1bc tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:03.123650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-aeb58f48-7712-48b4-9afa-ec9a7b03c1bc tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:03.137767 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-aeb58f48-7712-48b4-9afa-ec9a7b03c1bc tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] HTTP exception thrown: Instance 32204f28-6a74-4eb5-acb0-29332869a35c could not be found. Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-aeb58f48-7712-48b4-9afa-ec9a7b03c1bc tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Request method failure captured: Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c HTTP/1.1 Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-HF_CvukEL-2bb3b-m4USB_FDUWZ8ZG1KxatJbU3y36wG8_UHeLHyq1rrsTyiGIORKuBTn0S0vwJz0B9AUP_OfRRUyTkbNVUgBSDs9RaAwWGDCRBvPDIYXOE-gFun8dmF1LLy34MyE2EazIQ4FD_IWfDiuxx9PSWUnkJxS3xhcVolg Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: 8f19c17b2ebe4eb9bf21ea3440988401 Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-VolumesNegativeTest-359454753 Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:24:03.139411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:24:03.140967 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f19c17b2ebe4eb9bf21ea3440988401"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f19c17b2ebe4eb9bf21ea3440988401"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f19c17b2ebe4eb9bf21ea3440988401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f19c17b2ebe4eb9bf21ea3440988401"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:24:03.140967 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-VolumesNegativeTest-359454753 Aug 01 14:24:03.140967 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: 8f19c17b2ebe4eb9bf21ea3440988401 Aug 01 14:24:03.140967 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-VolumesNegativeTest-359454753 Aug 01 14:24:03.140967 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-VolumesNegativeTest-359454753-project Aug 01 14:24:03.140967 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:24:03.140967 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:24:03.140967 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: cca8ccda749c4254bc186598e1f645c2 Aug 01 14:24:03.140967 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-VolumesNegativeTest-359454753-project Aug 01 14:24:03.140967 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:24:03.140967 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 32204f28-6a74-4eb5-acb0-29332869a35c could not be found. Aug 01 14:24:03.140967 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '32204f28-6a74-4eb5-acb0-29332869a35c'} Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32204f28-6a74-4eb5-acb0-29332869a35c could not be found. Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:24:03.141945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32204f28-6a74-4eb5-acb0-29332869a35c could not be found. Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32204f28-6a74-4eb5-acb0-29332869a35c could not be found. Aug 01 14:24:03.143488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:24:03.144718 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-aeb58f48-7712-48b4-9afa-ec9a7b03c1bc tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] Returning 404 to user: Instance 32204f28-6a74-4eb5-acb0-29332869a35c could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:24:03.144718 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-aeb58f48-7712-48b4-9afa-ec9a7b03c1bc tempest-VolumesNegativeTest-359454753 tempest-VolumesNegativeTest-359454753-project] 10.222.0.49 "GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c" status: 404 len: 111 microversion: 2.1 time: 0.029716 Aug 01 14:24:03.144718 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 240/472] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:03 2022] GET /compute/v2.1/servers/32204f28-6a74-4eb5-acb0-29332869a35c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:24:03.577078 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e50abd72-b2cf-4a58-ba4b-9547ec1538c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:03.578375 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e50abd72-b2cf-4a58-ba4b-9547ec1538c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:03.585890 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e50abd72-b2cf-4a58-ba4b-9547ec1538c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:03.586343 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e50abd72-b2cf-4a58-ba4b-9547ec1538c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:03.587104 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e50abd72-b2cf-4a58-ba4b-9547ec1538c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:03.587701 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e50abd72-b2cf-4a58-ba4b-9547ec1538c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:03.759637 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e50abd72-b2cf-4a58-ba4b-9547ec1538c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:03.769198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e50abd72-b2cf-4a58-ba4b-9547ec1538c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:03.771812 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e50abd72-b2cf-4a58-ba4b-9547ec1538c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:03.774096 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e50abd72-b2cf-4a58-ba4b-9547ec1538c7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.201524 Aug 01 14:24:03.775480 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 233/473] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:03 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:04.797182 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-52d7b8a4-8f80-41d2-9126-47b2f7d3d4e9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:04.797827 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-52d7b8a4-8f80-41d2-9126-47b2f7d3d4e9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:04.806749 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-52d7b8a4-8f80-41d2-9126-47b2f7d3d4e9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:04.807220 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-52d7b8a4-8f80-41d2-9126-47b2f7d3d4e9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:04.808011 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-52d7b8a4-8f80-41d2-9126-47b2f7d3d4e9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:04.808457 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-52d7b8a4-8f80-41d2-9126-47b2f7d3d4e9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:04.962676 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-52d7b8a4-8f80-41d2-9126-47b2f7d3d4e9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:04.972155 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-52d7b8a4-8f80-41d2-9126-47b2f7d3d4e9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:04.973657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-52d7b8a4-8f80-41d2-9126-47b2f7d3d4e9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:04.976073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-52d7b8a4-8f80-41d2-9126-47b2f7d3d4e9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.183200 Aug 01 14:24:04.976523 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 241/474] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:04 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:05.999416 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-55ef2736-be77-43e8-a004-f0eb1d68a991 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:06.000030 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-55ef2736-be77-43e8-a004-f0eb1d68a991 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:06.007599 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-55ef2736-be77-43e8-a004-f0eb1d68a991 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:06.008057 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-55ef2736-be77-43e8-a004-f0eb1d68a991 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:06.008860 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-55ef2736-be77-43e8-a004-f0eb1d68a991 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:06.009299 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-55ef2736-be77-43e8-a004-f0eb1d68a991 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:06.139527 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-55ef2736-be77-43e8-a004-f0eb1d68a991 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:06.149010 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-55ef2736-be77-43e8-a004-f0eb1d68a991 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:06.150558 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-55ef2736-be77-43e8-a004-f0eb1d68a991 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:06.151720 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-55ef2736-be77-43e8-a004-f0eb1d68a991 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.156164 Aug 01 14:24:06.152300 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 234/475] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:05 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:07.175298 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-58b626c7-a7c6-4326-922c-7b1b9c1c5bb6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:07.176080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-58b626c7-a7c6-4326-922c-7b1b9c1c5bb6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:07.185159 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-58b626c7-a7c6-4326-922c-7b1b9c1c5bb6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:07.185732 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-58b626c7-a7c6-4326-922c-7b1b9c1c5bb6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:07.186643 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-58b626c7-a7c6-4326-922c-7b1b9c1c5bb6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:07.187179 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-58b626c7-a7c6-4326-922c-7b1b9c1c5bb6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:07.330560 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-58b626c7-a7c6-4326-922c-7b1b9c1c5bb6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:07.341877 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-58b626c7-a7c6-4326-922c-7b1b9c1c5bb6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:07.341877 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-58b626c7-a7c6-4326-922c-7b1b9c1c5bb6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:07.342754 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-58b626c7-a7c6-4326-922c-7b1b9c1c5bb6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.171944 Aug 01 14:24:07.343591 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 242/476] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:07 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:08.366881 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8a626044-f212-489b-b90d-b093f27356b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:08.368554 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8a626044-f212-489b-b90d-b093f27356b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:08.383969 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8a626044-f212-489b-b90d-b093f27356b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:08.384425 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8a626044-f212-489b-b90d-b093f27356b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:08.385342 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8a626044-f212-489b-b90d-b093f27356b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:08.385989 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8a626044-f212-489b-b90d-b093f27356b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:08.546926 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8a626044-f212-489b-b90d-b093f27356b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:08.554768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8a626044-f212-489b-b90d-b093f27356b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:08.556328 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8a626044-f212-489b-b90d-b093f27356b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:08.557492 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8a626044-f212-489b-b90d-b093f27356b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.194578 Aug 01 14:24:08.560929 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 235/477] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:08 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:09.580794 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-732369f9-306c-4de9-8b96-d23667d32f18 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:09.581402 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-732369f9-306c-4de9-8b96-d23667d32f18 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:09.591904 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-732369f9-306c-4de9-8b96-d23667d32f18 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:09.592361 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-732369f9-306c-4de9-8b96-d23667d32f18 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:09.593289 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-732369f9-306c-4de9-8b96-d23667d32f18 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:09.593936 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-732369f9-306c-4de9-8b96-d23667d32f18 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:09.747256 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-732369f9-306c-4de9-8b96-d23667d32f18 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:09.756835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-732369f9-306c-4de9-8b96-d23667d32f18 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:09.758691 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-732369f9-306c-4de9-8b96-d23667d32f18 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:09.760378 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-732369f9-306c-4de9-8b96-d23667d32f18 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.183535 Aug 01 14:24:09.761258 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 243/478] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:09 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:10.792507 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-403aa35b-82e2-4d96-9ad5-b387dec82024 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:10.794181 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-403aa35b-82e2-4d96-9ad5-b387dec82024 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:10.806154 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-403aa35b-82e2-4d96-9ad5-b387dec82024 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:10.806609 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-403aa35b-82e2-4d96-9ad5-b387dec82024 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:10.807421 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-403aa35b-82e2-4d96-9ad5-b387dec82024 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:10.808044 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-403aa35b-82e2-4d96-9ad5-b387dec82024 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:10.964195 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-403aa35b-82e2-4d96-9ad5-b387dec82024 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:10.977113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-403aa35b-82e2-4d96-9ad5-b387dec82024 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:10.979808 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-403aa35b-82e2-4d96-9ad5-b387dec82024 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:10.981003 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-403aa35b-82e2-4d96-9ad5-b387dec82024 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.192366 Aug 01 14:24:10.981781 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 236/479] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:10 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:12.009916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c70b8fad-2c12-44e2-adf9-24cca728fb79 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:12.010648 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c70b8fad-2c12-44e2-adf9-24cca728fb79 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:12.017127 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c70b8fad-2c12-44e2-adf9-24cca728fb79 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:12.017661 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c70b8fad-2c12-44e2-adf9-24cca728fb79 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:12.018543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c70b8fad-2c12-44e2-adf9-24cca728fb79 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:12.019139 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c70b8fad-2c12-44e2-adf9-24cca728fb79 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:12.160864 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c70b8fad-2c12-44e2-adf9-24cca728fb79 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:12.170075 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c70b8fad-2c12-44e2-adf9-24cca728fb79 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:12.171576 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c70b8fad-2c12-44e2-adf9-24cca728fb79 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:12.172736 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c70b8fad-2c12-44e2-adf9-24cca728fb79 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.167889 Aug 01 14:24:12.173299 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 244/480] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:12 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:13.197552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-481eb7c0-cea0-40d9-81fd-990be47f60a5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:13.199473 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-481eb7c0-cea0-40d9-81fd-990be47f60a5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:13.206827 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-481eb7c0-cea0-40d9-81fd-990be47f60a5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:13.207685 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-481eb7c0-cea0-40d9-81fd-990be47f60a5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:13.209637 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-481eb7c0-cea0-40d9-81fd-990be47f60a5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:13.210470 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-481eb7c0-cea0-40d9-81fd-990be47f60a5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:13.354091 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-481eb7c0-cea0-40d9-81fd-990be47f60a5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:13.363139 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-481eb7c0-cea0-40d9-81fd-990be47f60a5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:13.365899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-481eb7c0-cea0-40d9-81fd-990be47f60a5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:13.367164 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-481eb7c0-cea0-40d9-81fd-990be47f60a5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.174740 Aug 01 14:24:13.368093 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 237/481] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:13 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:14.390990 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-20e5bfe5-889b-4353-ac4d-a6bea2038f35 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:14.391671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-20e5bfe5-889b-4353-ac4d-a6bea2038f35 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:14.393531 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:14.398749 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-20e5bfe5-889b-4353-ac4d-a6bea2038f35 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:14.399227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-20e5bfe5-889b-4353-ac4d-a6bea2038f35 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:14.400277 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-20e5bfe5-889b-4353-ac4d-a6bea2038f35 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:14.400724 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-20e5bfe5-889b-4353-ac4d-a6bea2038f35 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:14.544323 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-20e5bfe5-889b-4353-ac4d-a6bea2038f35 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:14.557124 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-20e5bfe5-889b-4353-ac4d-a6bea2038f35 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:14.655704 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-20e5bfe5-889b-4353-ac4d-a6bea2038f35 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:14.655704 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-20e5bfe5-889b-4353-ac4d-a6bea2038f35 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.172992 Aug 01 14:24:14.655704 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 245/482] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:14 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:15.654636 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-768b131e-3eb7-4553-a6d5-81be16f08391 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:15.655294 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-768b131e-3eb7-4553-a6d5-81be16f08391 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:15.662056 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-768b131e-3eb7-4553-a6d5-81be16f08391 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:15.662511 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-768b131e-3eb7-4553-a6d5-81be16f08391 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:15.663269 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-768b131e-3eb7-4553-a6d5-81be16f08391 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:15.663706 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-768b131e-3eb7-4553-a6d5-81be16f08391 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:15.791181 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-768b131e-3eb7-4553-a6d5-81be16f08391 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:15.799492 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-768b131e-3eb7-4553-a6d5-81be16f08391 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:15.800983 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-768b131e-3eb7-4553-a6d5-81be16f08391 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:15.802178 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-768b131e-3eb7-4553-a6d5-81be16f08391 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.151623 Aug 01 14:24:15.802912 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 238/483] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:15 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:16.824659 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-bff06fdf-81e9-4b96-a879-c97c5e332926 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:16.825266 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-bff06fdf-81e9-4b96-a879-c97c5e332926 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:16.831430 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bff06fdf-81e9-4b96-a879-c97c5e332926 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:16.831881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bff06fdf-81e9-4b96-a879-c97c5e332926 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:16.832643 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bff06fdf-81e9-4b96-a879-c97c5e332926 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:16.833844 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bff06fdf-81e9-4b96-a879-c97c5e332926 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:16.967032 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bff06fdf-81e9-4b96-a879-c97c5e332926 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:16.976838 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bff06fdf-81e9-4b96-a879-c97c5e332926 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:16.978534 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bff06fdf-81e9-4b96-a879-c97c5e332926 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:16.979758 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-bff06fdf-81e9-4b96-a879-c97c5e332926 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.158934 Aug 01 14:24:16.980314 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 246/484] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:16 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:18.004138 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-41fd6407-fd8b-400c-b4c2-941c88b44a5a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:18.004715 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-41fd6407-fd8b-400c-b4c2-941c88b44a5a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:18.011756 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-41fd6407-fd8b-400c-b4c2-941c88b44a5a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:18.012210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-41fd6407-fd8b-400c-b4c2-941c88b44a5a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:18.012983 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-41fd6407-fd8b-400c-b4c2-941c88b44a5a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:18.013410 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-41fd6407-fd8b-400c-b4c2-941c88b44a5a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:18.142939 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-41fd6407-fd8b-400c-b4c2-941c88b44a5a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:18.151917 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-41fd6407-fd8b-400c-b4c2-941c88b44a5a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:18.156542 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-41fd6407-fd8b-400c-b4c2-941c88b44a5a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:18.156542 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-41fd6407-fd8b-400c-b4c2-941c88b44a5a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.154514 Aug 01 14:24:18.156542 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 239/485] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:17 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:18.492777 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0b2377b1-5fa8-490f-aad3-67d4d3f73e27 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:18.499325 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0b2377b1-5fa8-490f-aad3-67d4d3f73e27 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:18.499681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b2377b1-5fa8-490f-aad3-67d4d3f73e27 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:18.500139 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b2377b1-5fa8-490f-aad3-67d4d3f73e27 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:18.500903 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b2377b1-5fa8-490f-aad3-67d4d3f73e27 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:18.501338 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b2377b1-5fa8-490f-aad3-67d4d3f73e27 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:18.633784 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-0b2377b1-5fa8-490f-aad3-67d4d3f73e27 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lazy-loading 'services' on Instance uuid 6b499d85-fa7b-4fa0-b970-87213e327ef5 {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:24:18.931960 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0b2377b1-5fa8-490f-aad3-67d4d3f73e27 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5/os-volume_attachments/a4acfc66-9960-4ceb-bb4a-a797ac3269e2" status: 202 len: 0 microversion: 2.1 time: 0.443165 Aug 01 14:24:18.932575 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 247/486] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Aug 1 14:24:18 2022] DELETE /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5/os-volume_attachments/a4acfc66-9960-4ceb-bb4a-a797ac3269e2 => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:24:19.179484 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d654f393-f547-4989-9b65-3b748008c5f4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:19.180094 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d654f393-f547-4989-9b65-3b748008c5f4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:19.182496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=62 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:19.187217 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d654f393-f547-4989-9b65-3b748008c5f4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:19.187666 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d654f393-f547-4989-9b65-3b748008c5f4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:19.188428 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d654f393-f547-4989-9b65-3b748008c5f4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:19.188872 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d654f393-f547-4989-9b65-3b748008c5f4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:19.319084 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d654f393-f547-4989-9b65-3b748008c5f4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:19.327775 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d654f393-f547-4989-9b65-3b748008c5f4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:19.329301 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d654f393-f547-4989-9b65-3b748008c5f4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:19.330469 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d654f393-f547-4989-9b65-3b748008c5f4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.155504 Aug 01 14:24:19.331018 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 240/487] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:19 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:20.355404 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-8e1bead0-3ee8-4bcf-a5ff-f3c227939f1f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:20.356096 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-8e1bead0-3ee8-4bcf-a5ff-f3c227939f1f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:20.362454 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8e1bead0-3ee8-4bcf-a5ff-f3c227939f1f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:20.362901 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8e1bead0-3ee8-4bcf-a5ff-f3c227939f1f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:20.363698 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8e1bead0-3ee8-4bcf-a5ff-f3c227939f1f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:20.364101 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8e1bead0-3ee8-4bcf-a5ff-f3c227939f1f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:20.506473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-8e1bead0-3ee8-4bcf-a5ff-f3c227939f1f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:20.514786 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-8e1bead0-3ee8-4bcf-a5ff-f3c227939f1f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:20.516246 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-8e1bead0-3ee8-4bcf-a5ff-f3c227939f1f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:20.517383 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-8e1bead0-3ee8-4bcf-a5ff-f3c227939f1f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.166413 Aug 01 14:24:20.517973 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 248/488] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:20 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:21.482004 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-73a36614-7436-4ef2-8ed2-2d08e8827882 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:21.483850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-73a36614-7436-4ef2-8ed2-2d08e8827882 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:21.493407 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-73a36614-7436-4ef2-8ed2-2d08e8827882 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:21.493888 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-73a36614-7436-4ef2-8ed2-2d08e8827882 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:21.494698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-73a36614-7436-4ef2-8ed2-2d08e8827882 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:21.495190 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-73a36614-7436-4ef2-8ed2-2d08e8827882 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:21.520783 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-73a36614-7436-4ef2-8ed2-2d08e8827882 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Going to try to terminate instance {{(pid=118246) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:24:21.536694 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=100 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:21.542099 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0fb7590d-ee3a-40b0-a192-f04f8f4ec870 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:21.543310 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0fb7590d-ee3a-40b0-a192-f04f8f4ec870 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:21.549574 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0fb7590d-ee3a-40b0-a192-f04f8f4ec870 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:21.550076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0fb7590d-ee3a-40b0-a192-f04f8f4ec870 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:21.551127 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0fb7590d-ee3a-40b0-a192-f04f8f4ec870 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:21.552330 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0fb7590d-ee3a-40b0-a192-f04f8f4ec870 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:21.688172 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0fb7590d-ee3a-40b0-a192-f04f8f4ec870 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:21.696901 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0fb7590d-ee3a-40b0-a192-f04f8f4ec870 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:21.698443 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0fb7590d-ee3a-40b0-a192-f04f8f4ec870 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:21.699592 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0fb7590d-ee3a-40b0-a192-f04f8f4ec870 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.161570 Aug 01 14:24:21.700150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 249/489] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:21 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:24:21.815999 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-73a36614-7436-4ef2-8ed2-2d08e8827882 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 204 len: 0 microversion: 2.1 time: 0.337654 Aug 01 14:24:21.816599 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 241/490] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:24:21 2022] DELETE /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:24:21.825190 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-dfb42b99-4424-43fb-bf98-3587abe6b6ca tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:21.830695 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-dfb42b99-4424-43fb-bf98-3587abe6b6ca tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:21.831792 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dfb42b99-4424-43fb-bf98-3587abe6b6ca tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:21.832236 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dfb42b99-4424-43fb-bf98-3587abe6b6ca tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:21.832985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dfb42b99-4424-43fb-bf98-3587abe6b6ca tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:21.833473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dfb42b99-4424-43fb-bf98-3587abe6b6ca tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:21.970480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-dfb42b99-4424-43fb-bf98-3587abe6b6ca tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:21.979258 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-dfb42b99-4424-43fb-bf98-3587abe6b6ca tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1514 microversion: 2.1 time: 0.157841 Aug 01 14:24:21.981785 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 250/491] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:21 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:22.725175 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-587d91f8-9d6b-46bd-b426-1074fee47de3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:22.725856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-587d91f8-9d6b-46bd-b426-1074fee47de3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:22.732761 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-587d91f8-9d6b-46bd-b426-1074fee47de3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:22.733215 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-587d91f8-9d6b-46bd-b426-1074fee47de3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:22.734039 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-587d91f8-9d6b-46bd-b426-1074fee47de3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:22.734484 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-587d91f8-9d6b-46bd-b426-1074fee47de3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:22.875948 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-587d91f8-9d6b-46bd-b426-1074fee47de3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:22.884945 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-587d91f8-9d6b-46bd-b426-1074fee47de3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:22.886475 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-587d91f8-9d6b-46bd-b426-1074fee47de3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:22.887644 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-587d91f8-9d6b-46bd-b426-1074fee47de3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.167996 Aug 01 14:24:22.888223 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 242/492] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:22 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:23.001479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-bf0e4d76-236d-415a-822d-4adf7a90884b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:23.002048 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-bf0e4d76-236d-415a-822d-4adf7a90884b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:23.008245 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bf0e4d76-236d-415a-822d-4adf7a90884b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:23.008702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bf0e4d76-236d-415a-822d-4adf7a90884b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:23.009463 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bf0e4d76-236d-415a-822d-4adf7a90884b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:23.009945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bf0e4d76-236d-415a-822d-4adf7a90884b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:23.139126 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bf0e4d76-236d-415a-822d-4adf7a90884b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:23.146980 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-bf0e4d76-236d-415a-822d-4adf7a90884b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1514 microversion: 2.1 time: 0.149442 Aug 01 14:24:23.147540 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 251/493] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:22 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:23.910986 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-62244e9f-2763-4026-9b8e-d8b2867c4b86 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:23.911931 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-62244e9f-2763-4026-9b8e-d8b2867c4b86 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:23.918275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-62244e9f-2763-4026-9b8e-d8b2867c4b86 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:23.919185 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-62244e9f-2763-4026-9b8e-d8b2867c4b86 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:23.919621 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-62244e9f-2763-4026-9b8e-d8b2867c4b86 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:23.920057 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-62244e9f-2763-4026-9b8e-d8b2867c4b86 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:24.047095 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-62244e9f-2763-4026-9b8e-d8b2867c4b86 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:24.056060 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-62244e9f-2763-4026-9b8e-d8b2867c4b86 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:24.057562 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-62244e9f-2763-4026-9b8e-d8b2867c4b86 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:24.058746 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-62244e9f-2763-4026-9b8e-d8b2867c4b86 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.151649 Aug 01 14:24:24.059297 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 243/494] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:23 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:24.168295 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-dacff6bc-b66a-4556-8531-21c7779d852b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:24.168942 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-dacff6bc-b66a-4556-8531-21c7779d852b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:24.175035 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dacff6bc-b66a-4556-8531-21c7779d852b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:24.175488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dacff6bc-b66a-4556-8531-21c7779d852b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:24.176257 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dacff6bc-b66a-4556-8531-21c7779d852b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:24.176702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dacff6bc-b66a-4556-8531-21c7779d852b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:24.307536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-dacff6bc-b66a-4556-8531-21c7779d852b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:24.315037 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-dacff6bc-b66a-4556-8531-21c7779d852b tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1514 microversion: 2.1 time: 0.150537 Aug 01 14:24:24.315613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 252/495] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:24 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:25.082048 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-537601b4-530f-45bb-b2e6-4d1fb976798e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:25.082604 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-537601b4-530f-45bb-b2e6-4d1fb976798e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:25.089677 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-537601b4-530f-45bb-b2e6-4d1fb976798e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:25.090160 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-537601b4-530f-45bb-b2e6-4d1fb976798e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:25.090928 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-537601b4-530f-45bb-b2e6-4d1fb976798e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:25.091370 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-537601b4-530f-45bb-b2e6-4d1fb976798e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:25.216110 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-537601b4-530f-45bb-b2e6-4d1fb976798e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:25.224439 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-537601b4-530f-45bb-b2e6-4d1fb976798e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:25.226031 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-537601b4-530f-45bb-b2e6-4d1fb976798e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:25.227174 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-537601b4-530f-45bb-b2e6-4d1fb976798e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.149167 Aug 01 14:24:25.227722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 244/496] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:25 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:25.348112 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4596045e-b1ec-4cc4-a9bc-e4b692662905 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:25.349650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-4596045e-b1ec-4cc4-a9bc-e4b692662905 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:25.356771 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4596045e-b1ec-4cc4-a9bc-e4b692662905 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:25.357235 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4596045e-b1ec-4cc4-a9bc-e4b692662905 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:25.358033 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4596045e-b1ec-4cc4-a9bc-e4b692662905 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:25.358475 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4596045e-b1ec-4cc4-a9bc-e4b692662905 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:25.485842 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4596045e-b1ec-4cc4-a9bc-e4b692662905 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:25.495240 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4596045e-b1ec-4cc4-a9bc-e4b692662905 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1514 microversion: 2.1 time: 0.151201 Aug 01 14:24:25.495811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 253/497] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:25 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:25.873262 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-f6d2dd62-f42c-4bd8-bb30-a44f1cd9aa88 req-c427e009-1f94-4efb-8bcf-796e6230223e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b499d85-fa7b-4fa0-b970-87213e327ef5", "name": "network-vif-deleted", "tag": "545f2703-552c-4f53-95c9-72930069a993"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:25.883232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-f6d2dd62-f42c-4bd8-bb30-a44f1cd9aa88 req-c427e009-1f94-4efb-8bcf-796e6230223e service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:25.883705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-f6d2dd62-f42c-4bd8-bb30-a44f1cd9aa88 req-c427e009-1f94-4efb-8bcf-796e6230223e service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:25.894287 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-f6d2dd62-f42c-4bd8-bb30-a44f1cd9aa88 req-c427e009-1f94-4efb-8bcf-796e6230223e service nova] Creating event network-vif-deleted:545f2703-552c-4f53-95c9-72930069a993 for instance 6b499d85-fa7b-4fa0-b970-87213e327ef5 on hv-cinder-78729 Aug 01 14:24:25.899589 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-f6d2dd62-f42c-4bd8-bb30-a44f1cd9aa88 req-c427e009-1f94-4efb-8bcf-796e6230223e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030086 Aug 01 14:24:25.900167 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 245/498] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:26.250786 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-82f3532e-d3ea-4abb-8d01-fcca1e5ca77d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:26.251314 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-82f3532e-d3ea-4abb-8d01-fcca1e5ca77d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:26.257249 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-82f3532e-d3ea-4abb-8d01-fcca1e5ca77d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:26.257697 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-82f3532e-d3ea-4abb-8d01-fcca1e5ca77d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:26.258490 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-82f3532e-d3ea-4abb-8d01-fcca1e5ca77d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:26.258929 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-82f3532e-d3ea-4abb-8d01-fcca1e5ca77d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:26.389823 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-82f3532e-d3ea-4abb-8d01-fcca1e5ca77d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:26.398492 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-82f3532e-d3ea-4abb-8d01-fcca1e5ca77d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:26.400001 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-82f3532e-d3ea-4abb-8d01-fcca1e5ca77d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:26.401163 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-82f3532e-d3ea-4abb-8d01-fcca1e5ca77d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.154333 Aug 01 14:24:26.401728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 254/499] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:26 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:26.518825 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-62683dc7-dc74-4056-b5f7-e54c560726c3 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:26.519439 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-62683dc7-dc74-4056-b5f7-e54c560726c3 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:26.526220 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-62683dc7-dc74-4056-b5f7-e54c560726c3 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:26.526663 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-62683dc7-dc74-4056-b5f7-e54c560726c3 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:26.527423 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-62683dc7-dc74-4056-b5f7-e54c560726c3 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:26.527854 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-62683dc7-dc74-4056-b5f7-e54c560726c3 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:26.589228 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-62683dc7-dc74-4056-b5f7-e54c560726c3 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:26.596831 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-62683dc7-dc74-4056-b5f7-e54c560726c3 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 200 len: 1304 microversion: 2.1 time: 0.082887 Aug 01 14:24:26.597386 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 246/500] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:26 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 1304 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:27.424889 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-5ce31e64-1a60-4e58-88fe-0a340c07add1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:27.425633 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-5ce31e64-1a60-4e58-88fe-0a340c07add1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:27.432539 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5ce31e64-1a60-4e58-88fe-0a340c07add1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:27.432976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5ce31e64-1a60-4e58-88fe-0a340c07add1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:27.434087 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5ce31e64-1a60-4e58-88fe-0a340c07add1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:27.434586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5ce31e64-1a60-4e58-88fe-0a340c07add1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:27.439567 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:27.586372 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-5ce31e64-1a60-4e58-88fe-0a340c07add1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:27.595138 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-5ce31e64-1a60-4e58-88fe-0a340c07add1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:27.596628 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-5ce31e64-1a60-4e58-88fe-0a340c07add1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:27.597805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-5ce31e64-1a60-4e58-88fe-0a340c07add1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.177138 Aug 01 14:24:27.602974 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 255/501] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:27 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:27.619063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f0591bb0-7797-4b5c-a5e4-71806bdd6ea6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:27.619683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f0591bb0-7797-4b5c-a5e4-71806bdd6ea6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 6b499d85-fa7b-4fa0-b970-87213e327ef5] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:27.626292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f0591bb0-7797-4b5c-a5e4-71806bdd6ea6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:27.626743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f0591bb0-7797-4b5c-a5e4-71806bdd6ea6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:27.627522 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f0591bb0-7797-4b5c-a5e4-71806bdd6ea6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:27.627964 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f0591bb0-7797-4b5c-a5e4-71806bdd6ea6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:27.642085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-f0591bb0-7797-4b5c-a5e4-71806bdd6ea6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] HTTP exception thrown: Instance 6b499d85-fa7b-4fa0-b970-87213e327ef5 could not be found. Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f0591bb0-7797-4b5c-a5e4-71806bdd6ea6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Request method failure captured: Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 HTTP/1.1 Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-Gs50FDoprjvGZBBcBoG-icKc9wRgOgNNgeZT64aSL4fV4wf1Q8sODtoaWXXHyHKdUzibcJ33yjWZn5vpMWBx5n7htvxLA_NzQMDfNJEsqIYPuywBe5hM1pFKysaLVScjJKC2Fqq3dW7bMVtp4cqRLPrgjQwj4b066WM_IHNmc9M7Y Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: 714cc98080ae4baaa11b8b946c67ba2c Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-VolumesSnapshotTestJSON-849995764 Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:24:27.643722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:24:27.645313 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/714cc98080ae4baaa11b8b946c67ba2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_714cc98080ae4baaa11b8b946c67ba2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/714cc98080ae4baaa11b8b946c67ba2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/714cc98080ae4baaa11b8b946c67ba2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:24:27.645313 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-VolumesSnapshotTestJSON-849995764 Aug 01 14:24:27.645313 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: 714cc98080ae4baaa11b8b946c67ba2c Aug 01 14:24:27.645313 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-849995764 Aug 01 14:24:27.645313 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-VolumesSnapshotTestJSON-849995764-project Aug 01 14:24:27.645313 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:24:27.645313 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:24:27.645313 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: 0097e07390144f3a804eb5057c6b75e5 Aug 01 14:24:27.645313 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-VolumesSnapshotTestJSON-849995764-project Aug 01 14:24:27.645313 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:24:27.645313 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance 6b499d85-fa7b-4fa0-b970-87213e327ef5 could not be found. Aug 01 14:24:27.645313 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': '6b499d85-fa7b-4fa0-b970-87213e327ef5'} Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b499d85-fa7b-4fa0-b970-87213e327ef5 could not be found. Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:24:27.646523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b499d85-fa7b-4fa0-b970-87213e327ef5 could not be found. Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b499d85-fa7b-4fa0-b970-87213e327ef5 could not be found. Aug 01 14:24:27.647997 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:24:27.649630 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f0591bb0-7797-4b5c-a5e4-71806bdd6ea6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Returning 404 to user: Instance 6b499d85-fa7b-4fa0-b970-87213e327ef5 could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:24:27.649630 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f0591bb0-7797-4b5c-a5e4-71806bdd6ea6 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5" status: 404 len: 111 microversion: 2.1 time: 0.031240 Aug 01 14:24:27.649977 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 247/502] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:27 2022] GET /compute/v2.1/servers/6b499d85-fa7b-4fa0-b970-87213e327ef5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:24:28.621295 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a432c046-d090-42c1-9847-1a830b985ee1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:28.621926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a432c046-d090-42c1-9847-1a830b985ee1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:28.628092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a432c046-d090-42c1-9847-1a830b985ee1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:28.628543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a432c046-d090-42c1-9847-1a830b985ee1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:28.629305 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a432c046-d090-42c1-9847-1a830b985ee1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:28.630267 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a432c046-d090-42c1-9847-1a830b985ee1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:28.756677 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a432c046-d090-42c1-9847-1a830b985ee1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:28.765162 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a432c046-d090-42c1-9847-1a830b985ee1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:28.766693 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a432c046-d090-42c1-9847-1a830b985ee1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:28.767839 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a432c046-d090-42c1-9847-1a830b985ee1 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.151059 Aug 01 14:24:28.768391 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 256/503] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:28 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:29.791483 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-23f8d589-5ed8-4e8c-9b81-928286cefddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:29.792094 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-23f8d589-5ed8-4e8c-9b81-928286cefddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:29.798390 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-23f8d589-5ed8-4e8c-9b81-928286cefddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:29.798842 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-23f8d589-5ed8-4e8c-9b81-928286cefddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:29.799599 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-23f8d589-5ed8-4e8c-9b81-928286cefddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:29.800037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-23f8d589-5ed8-4e8c-9b81-928286cefddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:29.932232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-23f8d589-5ed8-4e8c-9b81-928286cefddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:29.940552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-23f8d589-5ed8-4e8c-9b81-928286cefddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:29.942076 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-23f8d589-5ed8-4e8c-9b81-928286cefddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:29.943879 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-23f8d589-5ed8-4e8c-9b81-928286cefddc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.156378 Aug 01 14:24:29.944425 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 248/504] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:29 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:30.966056 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4af2cdb1-af07-4ea9-9a41-40affe901199 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:30.966662 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-4af2cdb1-af07-4ea9-9a41-40affe901199 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:30.972737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4af2cdb1-af07-4ea9-9a41-40affe901199 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:30.973199 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4af2cdb1-af07-4ea9-9a41-40affe901199 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:30.974685 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4af2cdb1-af07-4ea9-9a41-40affe901199 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:30.975119 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4af2cdb1-af07-4ea9-9a41-40affe901199 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:31.107853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4af2cdb1-af07-4ea9-9a41-40affe901199 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:31.116511 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4af2cdb1-af07-4ea9-9a41-40affe901199 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:31.118324 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4af2cdb1-af07-4ea9-9a41-40affe901199 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:31.119512 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4af2cdb1-af07-4ea9-9a41-40affe901199 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.157334 Aug 01 14:24:31.120065 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 257/505] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:30 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:31.325647 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4185c160-a617-43de-b40b-6e2b01edbfdc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:31.326174 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4185c160-a617-43de-b40b-6e2b01edbfdc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:31.332519 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4185c160-a617-43de-b40b-6e2b01edbfdc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:31.333012 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4185c160-a617-43de-b40b-6e2b01edbfdc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:31.334039 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4185c160-a617-43de-b40b-6e2b01edbfdc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:31.334481 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4185c160-a617-43de-b40b-6e2b01edbfdc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:31.461564 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-4185c160-a617-43de-b40b-6e2b01edbfdc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lazy-loading 'services' on Instance uuid 2eb5f425-d747-41d4-bed5-211a5d80e32b {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:24:31.509111 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-1a8e2e02-ec43-4d56-b71f-8e0b14626474 req-341ee086-51b6-4e1a-b61f-66d74d41d48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c41c564-40f2-47cf-820b-915c3d43ccb3", "name": "network-vif-plugged", "status": "completed", "tag": "bc816aff-9768-4c40-a6d1-adb40e9ce6a1"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:31.520899 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-1a8e2e02-ec43-4d56-b71f-8e0b14626474 req-341ee086-51b6-4e1a-b61f-66d74d41d48e service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:31.521705 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-1a8e2e02-ec43-4d56-b71f-8e0b14626474 req-341ee086-51b6-4e1a-b61f-66d74d41d48e service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:31.537018 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-1a8e2e02-ec43-4d56-b71f-8e0b14626474 req-341ee086-51b6-4e1a-b61f-66d74d41d48e service nova] Creating event network-vif-plugged:bc816aff-9768-4c40-a6d1-adb40e9ce6a1 for instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 on hv-cinder-78729 Aug 01 14:24:31.542365 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-1a8e2e02-ec43-4d56-b71f-8e0b14626474 req-341ee086-51b6-4e1a-b61f-66d74d41d48e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037384 Aug 01 14:24:31.543153 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 258/506] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:24:31.706248 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4185c160-a617-43de-b40b-6e2b01edbfdc tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/os-volume_attachments/3fdfd3a4-1a6c-41d0-b3c2-93b528023b35" status: 202 len: 0 microversion: 2.1 time: 0.384552 Aug 01 14:24:31.706857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 249/507] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Aug 1 14:24:31 2022] DELETE /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/os-volume_attachments/3fdfd3a4-1a6c-41d0-b3c2-93b528023b35 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:24:32.145042 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a3b4aadc-037c-40de-b89b-e0e6a756f899 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:32.147081 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a3b4aadc-037c-40de-b89b-e0e6a756f899 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:32.153487 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3b4aadc-037c-40de-b89b-e0e6a756f899 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:32.153997 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3b4aadc-037c-40de-b89b-e0e6a756f899 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:32.154769 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3b4aadc-037c-40de-b89b-e0e6a756f899 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:32.155208 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3b4aadc-037c-40de-b89b-e0e6a756f899 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:32.306940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a3b4aadc-037c-40de-b89b-e0e6a756f899 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:32.315156 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a3b4aadc-037c-40de-b89b-e0e6a756f899 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:32.316814 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a3b4aadc-037c-40de-b89b-e0e6a756f899 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:32.318421 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a3b4aadc-037c-40de-b89b-e0e6a756f899 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.178622 Aug 01 14:24:32.318982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 259/508] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:32 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:24:33.343338 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e8cdd838-de7d-425f-b6e7-3ffd8d787b70 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:33.344034 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e8cdd838-de7d-425f-b6e7-3ffd8d787b70 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:33.350685 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e8cdd838-de7d-425f-b6e7-3ffd8d787b70 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:33.351229 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e8cdd838-de7d-425f-b6e7-3ffd8d787b70 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:33.352003 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e8cdd838-de7d-425f-b6e7-3ffd8d787b70 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:33.352442 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e8cdd838-de7d-425f-b6e7-3ffd8d787b70 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:33.483146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e8cdd838-de7d-425f-b6e7-3ffd8d787b70 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:33.492208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e8cdd838-de7d-425f-b6e7-3ffd8d787b70 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:33.494074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e8cdd838-de7d-425f-b6e7-3ffd8d787b70 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:33.495159 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e8cdd838-de7d-425f-b6e7-3ffd8d787b70 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.156640 Aug 01 14:24:33.495718 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 250/509] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:33 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:34.518515 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-198f46e7-103e-4877-bf3f-0782e22100ab tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:34.519127 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-198f46e7-103e-4877-bf3f-0782e22100ab tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:34.525452 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-198f46e7-103e-4877-bf3f-0782e22100ab tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:34.525947 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-198f46e7-103e-4877-bf3f-0782e22100ab tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:34.526725 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-198f46e7-103e-4877-bf3f-0782e22100ab tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:34.527165 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-198f46e7-103e-4877-bf3f-0782e22100ab tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:34.655903 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-198f46e7-103e-4877-bf3f-0782e22100ab tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:34.665106 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-198f46e7-103e-4877-bf3f-0782e22100ab tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:34.666636 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-198f46e7-103e-4877-bf3f-0782e22100ab tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:34.667791 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-198f46e7-103e-4877-bf3f-0782e22100ab tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.153184 Aug 01 14:24:34.668345 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 260/510] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:34 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:35.118624 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0c2516f7-6aad-4120-9182-6be13d49587f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:35.125243 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0c2516f7-6aad-4120-9182-6be13d49587f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:35.125696 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0c2516f7-6aad-4120-9182-6be13d49587f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:35.149231 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0c2516f7-6aad-4120-9182-6be13d49587f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Going to try to stop instance {{(pid=118246) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 14:24:35.311460 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0c2516f7-6aad-4120-9182-6be13d49587f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "POST /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/action" status: 202 len: 0 microversion: 2.1 time: 0.196858 Aug 01 14:24:35.312064 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 251/511] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Aug 1 14:24:35 2022] POST /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:24:35.320186 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e014f83f-5a1e-46b6-9269-89bdbe569464 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:35.320769 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e014f83f-5a1e-46b6-9269-89bdbe569464 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:35.326802 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e014f83f-5a1e-46b6-9269-89bdbe569464 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:35.327262 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e014f83f-5a1e-46b6-9269-89bdbe569464 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:35.328084 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e014f83f-5a1e-46b6-9269-89bdbe569464 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:35.328514 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e014f83f-5a1e-46b6-9269-89bdbe569464 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:35.461090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e014f83f-5a1e-46b6-9269-89bdbe569464 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:35.469055 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e014f83f-5a1e-46b6-9269-89bdbe569464 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1677 microversion: 2.1 time: 0.152775 Aug 01 14:24:35.469711 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 261/512] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:35 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:35.691820 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-6454fead-4a08-4c58-8875-f0520cf66a34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:35.692520 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-6454fead-4a08-4c58-8875-f0520cf66a34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:35.698746 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6454fead-4a08-4c58-8875-f0520cf66a34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:35.699221 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6454fead-4a08-4c58-8875-f0520cf66a34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:35.699977 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6454fead-4a08-4c58-8875-f0520cf66a34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:35.700415 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6454fead-4a08-4c58-8875-f0520cf66a34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:35.834015 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-6454fead-4a08-4c58-8875-f0520cf66a34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:35.842384 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-6454fead-4a08-4c58-8875-f0520cf66a34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:35.844152 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-6454fead-4a08-4c58-8875-f0520cf66a34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:35.845027 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-6454fead-4a08-4c58-8875-f0520cf66a34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.157518 Aug 01 14:24:35.845574 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 252/513] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:35 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:36.491529 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-2642261b-1ac1-4204-b7d7-a9984d2263ab tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:36.492049 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-2642261b-1ac1-4204-b7d7-a9984d2263ab tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:36.498370 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2642261b-1ac1-4204-b7d7-a9984d2263ab tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:36.498823 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2642261b-1ac1-4204-b7d7-a9984d2263ab tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:36.499592 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2642261b-1ac1-4204-b7d7-a9984d2263ab tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:36.500035 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2642261b-1ac1-4204-b7d7-a9984d2263ab tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:36.624689 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2642261b-1ac1-4204-b7d7-a9984d2263ab tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:36.633129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-2642261b-1ac1-4204-b7d7-a9984d2263ab tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1677 microversion: 2.1 time: 0.146126 Aug 01 14:24:36.633702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 262/514] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:36 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:36.868653 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-67e55b8c-be7c-43c1-9cae-677736e8041f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:36.869262 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-67e55b8c-be7c-43c1-9cae-677736e8041f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:36.875826 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-67e55b8c-be7c-43c1-9cae-677736e8041f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:36.876281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-67e55b8c-be7c-43c1-9cae-677736e8041f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:36.877042 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-67e55b8c-be7c-43c1-9cae-677736e8041f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:36.877533 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-67e55b8c-be7c-43c1-9cae-677736e8041f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:37.010579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-67e55b8c-be7c-43c1-9cae-677736e8041f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:37.019039 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-67e55b8c-be7c-43c1-9cae-677736e8041f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:37.021162 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-67e55b8c-be7c-43c1-9cae-677736e8041f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:37.022348 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-67e55b8c-be7c-43c1-9cae-677736e8041f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1809 microversion: 2.20 time: 0.157938 Aug 01 14:24:37.022911 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 253/515] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:36 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:37.654222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-24c696ec-f9dc-490c-a303-e2c5f3bb1744 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:37.654909 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-24c696ec-f9dc-490c-a303-e2c5f3bb1744 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:37.662074 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-24c696ec-f9dc-490c-a303-e2c5f3bb1744 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:37.662569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-24c696ec-f9dc-490c-a303-e2c5f3bb1744 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:37.663504 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-24c696ec-f9dc-490c-a303-e2c5f3bb1744 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:37.663947 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-24c696ec-f9dc-490c-a303-e2c5f3bb1744 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:37.793063 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-24c696ec-f9dc-490c-a303-e2c5f3bb1744 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:37.800991 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-24c696ec-f9dc-490c-a303-e2c5f3bb1744 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1677 microversion: 2.1 time: 0.150711 Aug 01 14:24:37.801595 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 263/516] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:37 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:38.045044 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-46fbb9c7-3e19-443e-a97d-bfa351a48141 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:38.045654 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-46fbb9c7-3e19-443e-a97d-bfa351a48141 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:38.052863 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-46fbb9c7-3e19-443e-a97d-bfa351a48141 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:38.053304 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-46fbb9c7-3e19-443e-a97d-bfa351a48141 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:38.054092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-46fbb9c7-3e19-443e-a97d-bfa351a48141 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:38.054526 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-46fbb9c7-3e19-443e-a97d-bfa351a48141 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:38.184933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-46fbb9c7-3e19-443e-a97d-bfa351a48141 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:38.194667 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-46fbb9c7-3e19-443e-a97d-bfa351a48141 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:38.196221 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-46fbb9c7-3e19-443e-a97d-bfa351a48141 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:38.197598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-46fbb9c7-3e19-443e-a97d-bfa351a48141 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1796 microversion: 2.20 time: 0.156272 Aug 01 14:24:38.197974 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 254/517] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:24:38 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1796 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:24:38.282345 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-da9d6f8d-c5af-40b4-8b97-59acb126215d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-167509963", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452", "networks": [{"uuid": "94f6cc2e-7bf3-42cf-99c8-31d89c32275b"}]}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:38.335115 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.network.neutron [None req-da9d6f8d-c5af-40b4-8b97-59acb126215d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] validate_networks() for [('94f6cc2e-7bf3-42cf-99c8-31d89c32275b', None, None, None, None, None)] {{(pid=118247) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:24:38.679560 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-da9d6f8d-c5af-40b4-8b97-59acb126215d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Flavor limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:24:38.680143 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-da9d6f8d-c5af-40b4-8b97-59acb126215d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Image limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:24:38.680448 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-da9d6f8d-c5af-40b4-8b97-59acb126215d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Flavor pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:24:38.680888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-da9d6f8d-c5af-40b4-8b97-59acb126215d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Image pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:24:38.681301 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-da9d6f8d-c5af-40b4-8b97-59acb126215d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:24:38.690168 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-da9d6f8d-c5af-40b4-8b97-59acb126215d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:38.690616 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-da9d6f8d-c5af-40b4-8b97-59acb126215d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:38.691416 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-da9d6f8d-c5af-40b4-8b97-59acb126215d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:38.691854 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-da9d6f8d-c5af-40b4-8b97-59acb126215d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:38.709414 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-da9d6f8d-c5af-40b4-8b97-59acb126215d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Getting quotas for project 714cc98080ae4baaa11b8b946c67ba2c. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:24:38.713459 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-da9d6f8d-c5af-40b4-8b97-59acb126215d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Getting quotas for user 0097e07390144f3a804eb5057c6b75e5 and project 714cc98080ae4baaa11b8b946c67ba2c. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:24:38.724339 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-da9d6f8d-c5af-40b4-8b97-59acb126215d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Going to run 1 instances... {{(pid=118247) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:24:38.726604 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-da9d6f8d-c5af-40b4-8b97-59acb126215d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118247) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:24:38.823041 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ff8a7db0-3a59-4022-aba1-83771c266769 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:38.823578 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ff8a7db0-3a59-4022-aba1-83771c266769 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:38.829572 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ff8a7db0-3a59-4022-aba1-83771c266769 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:38.830105 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ff8a7db0-3a59-4022-aba1-83771c266769 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:38.830836 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ff8a7db0-3a59-4022-aba1-83771c266769 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:38.831270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ff8a7db0-3a59-4022-aba1-83771c266769 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:38.935763 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-da9d6f8d-c5af-40b4-8b97-59acb126215d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657183 Aug 01 14:24:38.936598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 264/518] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:24:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:24:38.947485 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1cbe8c47-1555-4604-88d0-2e7761f9bfcc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:38.948103 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1cbe8c47-1555-4604-88d0-2e7761f9bfcc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:38.962603 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ff8a7db0-3a59-4022-aba1-83771c266769 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:38.970351 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ff8a7db0-3a59-4022-aba1-83771c266769 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1677 microversion: 2.1 time: 0.151291 Aug 01 14:24:38.974827 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 255/519] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:38 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:39.005701 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1cbe8c47-1555-4604-88d0-2e7761f9bfcc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:39.013743 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1cbe8c47-1555-4604-88d0-2e7761f9bfcc tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 200 len: 1218 microversion: 2.1 time: 0.070500 Aug 01 14:24:39.014409 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 265/520] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:38 2022] GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:24:39.992742 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-aa6c712e-c5df-4143-a374-d9bd0486d38a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:39.993294 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-aa6c712e-c5df-4143-a374-d9bd0486d38a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:39.999662 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-aa6c712e-c5df-4143-a374-d9bd0486d38a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:40.000110 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-aa6c712e-c5df-4143-a374-d9bd0486d38a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:40.000872 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-aa6c712e-c5df-4143-a374-d9bd0486d38a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:40.001307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-aa6c712e-c5df-4143-a374-d9bd0486d38a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:40.035167 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-30e00605-bca8-4d21-91fa-e7a10bb7cd66 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:40.035829 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-30e00605-bca8-4d21-91fa-e7a10bb7cd66 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:40.042341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-30e00605-bca8-4d21-91fa-e7a10bb7cd66 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:40.042797 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-30e00605-bca8-4d21-91fa-e7a10bb7cd66 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:40.043580 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-30e00605-bca8-4d21-91fa-e7a10bb7cd66 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:40.044014 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-30e00605-bca8-4d21-91fa-e7a10bb7cd66 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:40.115285 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-30e00605-bca8-4d21-91fa-e7a10bb7cd66 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:40.123146 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-30e00605-bca8-4d21-91fa-e7a10bb7cd66 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 200 len: 1222 microversion: 2.1 time: 0.091871 Aug 01 14:24:40.123737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 266/521] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:40 2022] GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:40.160436 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-aa6c712e-c5df-4143-a374-d9bd0486d38a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:40.164325 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:40.168636 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-aa6c712e-c5df-4143-a374-d9bd0486d38a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1677 microversion: 2.1 time: 0.180165 Aug 01 14:24:40.169208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 256/522] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:39 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:41.143270 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-de4c12e8-291b-4242-8396-de85f5063eba tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:41.143889 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-de4c12e8-291b-4242-8396-de85f5063eba tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:41.150536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-de4c12e8-291b-4242-8396-de85f5063eba tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:41.151000 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-de4c12e8-291b-4242-8396-de85f5063eba tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:41.151772 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-de4c12e8-291b-4242-8396-de85f5063eba tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:41.152211 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-de4c12e8-291b-4242-8396-de85f5063eba tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:41.189734 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1898560a-4901-4f28-9585-bdf755927474 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:41.190651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-1898560a-4901-4f28-9585-bdf755927474 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:41.198449 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1898560a-4901-4f28-9585-bdf755927474 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:41.199321 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1898560a-4901-4f28-9585-bdf755927474 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:41.200319 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1898560a-4901-4f28-9585-bdf755927474 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:41.201132 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1898560a-4901-4f28-9585-bdf755927474 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:41.215850 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-de4c12e8-291b-4242-8396-de85f5063eba tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:41.227203 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-de4c12e8-291b-4242-8396-de85f5063eba tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 200 len: 1278 microversion: 2.1 time: 0.087688 Aug 01 14:24:41.237737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 267/523] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:41 2022] GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:41.342025 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-1898560a-4901-4f28-9585-bdf755927474 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:41.350587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-1898560a-4901-4f28-9585-bdf755927474 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1677 microversion: 2.1 time: 0.164938 Aug 01 14:24:41.351573 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 257/524] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:41 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:42.249984 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4f9e0756-1bee-40a2-80ec-75b9b2d76441 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:42.250550 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-4f9e0756-1bee-40a2-80ec-75b9b2d76441 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:42.257237 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4f9e0756-1bee-40a2-80ec-75b9b2d76441 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:42.257695 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4f9e0756-1bee-40a2-80ec-75b9b2d76441 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:42.258491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4f9e0756-1bee-40a2-80ec-75b9b2d76441 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:42.258932 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4f9e0756-1bee-40a2-80ec-75b9b2d76441 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:42.371464 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-6fcb974b-24be-4ba6-bfe0-02086da67556 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:42.372938 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-6fcb974b-24be-4ba6-bfe0-02086da67556 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:42.380288 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6fcb974b-24be-4ba6-bfe0-02086da67556 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:42.381492 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6fcb974b-24be-4ba6-bfe0-02086da67556 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:42.382707 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6fcb974b-24be-4ba6-bfe0-02086da67556 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:42.383349 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6fcb974b-24be-4ba6-bfe0-02086da67556 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:42.389010 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4f9e0756-1bee-40a2-80ec-75b9b2d76441 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:42.398706 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4f9e0756-1bee-40a2-80ec-75b9b2d76441 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 200 len: 1318 microversion: 2.1 time: 0.152884 Aug 01 14:24:42.399682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 268/525] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:42 2022] GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:42.515106 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-6fcb974b-24be-4ba6-bfe0-02086da67556 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:42.523835 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-6fcb974b-24be-4ba6-bfe0-02086da67556 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1677 microversion: 2.1 time: 0.156381 Aug 01 14:24:42.524419 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 258/526] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:42 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:24:42.649314 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-21e804da-293a-4009-80d5-a305883e7801 req-6195de23-ee3a-4bc8-b549-b0d7a3b697f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "581ed715-d508-4de6-b1ba-8c7d089442b6", "tag": "42d37763-67b7-4c96-9d71-e893c62566f2"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:42.659084 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-21e804da-293a-4009-80d5-a305883e7801 req-6195de23-ee3a-4bc8-b549-b0d7a3b697f3 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:42.659532 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-21e804da-293a-4009-80d5-a305883e7801 req-6195de23-ee3a-4bc8-b549-b0d7a3b697f3 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:42.671458 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-21e804da-293a-4009-80d5-a305883e7801 req-6195de23-ee3a-4bc8-b549-b0d7a3b697f3 service nova] Creating event network-changed:42d37763-67b7-4c96-9d71-e893c62566f2 for instance 581ed715-d508-4de6-b1ba-8c7d089442b6 on hv-cinder-78729 Aug 01 14:24:42.676582 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-21e804da-293a-4009-80d5-a305883e7801 req-6195de23-ee3a-4bc8-b549-b0d7a3b697f3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031432 Aug 01 14:24:42.677418 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 269/527] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:43.420641 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d090c499-8268-4ff4-b305-c5081e679662 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:43.421365 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d090c499-8268-4ff4-b305-c5081e679662 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:43.428027 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d090c499-8268-4ff4-b305-c5081e679662 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:43.428481 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d090c499-8268-4ff4-b305-c5081e679662 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:43.429262 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d090c499-8268-4ff4-b305-c5081e679662 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:43.429731 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d090c499-8268-4ff4-b305-c5081e679662 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:43.548816 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7b0341bf-8484-4bb8-9b2c-46f7a84d2bcf tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:43.549525 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7b0341bf-8484-4bb8-9b2c-46f7a84d2bcf tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:43.556790 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7b0341bf-8484-4bb8-9b2c-46f7a84d2bcf tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:43.557248 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7b0341bf-8484-4bb8-9b2c-46f7a84d2bcf tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:43.558137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7b0341bf-8484-4bb8-9b2c-46f7a84d2bcf tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:43.558638 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7b0341bf-8484-4bb8-9b2c-46f7a84d2bcf tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:43.855865 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d090c499-8268-4ff4-b305-c5081e679662 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:43.862200 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d090c499-8268-4ff4-b305-c5081e679662 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 200 len: 1318 microversion: 2.1 time: 0.445393 Aug 01 14:24:43.862832 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 259/528] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:43 2022] GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:43.869776 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7b0341bf-8484-4bb8-9b2c-46f7a84d2bcf tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:43.878864 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7b0341bf-8484-4bb8-9b2c-46f7a84d2bcf tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1677 microversion: 2.1 time: 0.334483 Aug 01 14:24:43.879444 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 270/529] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:43 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1677 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:24:44.885128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-fc9c08c9-3266-49da-9617-5c5d11f25931 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:44.885743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-fc9c08c9-3266-49da-9617-5c5d11f25931 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:44.892559 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fc9c08c9-3266-49da-9617-5c5d11f25931 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:44.893005 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fc9c08c9-3266-49da-9617-5c5d11f25931 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:44.893771 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fc9c08c9-3266-49da-9617-5c5d11f25931 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:44.894218 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fc9c08c9-3266-49da-9617-5c5d11f25931 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:44.900158 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-36c092b5-47de-494c-a05b-02c3e198dd6f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:44.900905 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-36c092b5-47de-494c-a05b-02c3e198dd6f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:44.902856 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:44.907566 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-36c092b5-47de-494c-a05b-02c3e198dd6f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:44.908019 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-36c092b5-47de-494c-a05b-02c3e198dd6f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:44.908796 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-36c092b5-47de-494c-a05b-02c3e198dd6f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:44.909297 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-36c092b5-47de-494c-a05b-02c3e198dd6f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:45.090349 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-fc9c08c9-3266-49da-9617-5c5d11f25931 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:45.097292 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-36c092b5-47de-494c-a05b-02c3e198dd6f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:45.097727 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-fc9c08c9-3266-49da-9617-5c5d11f25931 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 200 len: 1318 microversion: 2.1 time: 0.217720 Aug 01 14:24:45.098331 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 260/530] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:44 2022] GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:45.105143 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-36c092b5-47de-494c-a05b-02c3e198dd6f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1677 microversion: 2.1 time: 0.209287 Aug 01 14:24:45.105703 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 271/531] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:44 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:24:46.118878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-9bb4f522-f8eb-403b-a921-a177787cc14d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:46.119579 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-9bb4f522-f8eb-403b-a921-a177787cc14d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:46.126664 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a5985d29-53fb-49de-94c2-aba9bb2df2c2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:46.127205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9bb4f522-f8eb-403b-a921-a177787cc14d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:46.127302 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a5985d29-53fb-49de-94c2-aba9bb2df2c2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:46.127959 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9bb4f522-f8eb-403b-a921-a177787cc14d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:46.129007 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9bb4f522-f8eb-403b-a921-a177787cc14d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:46.129454 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9bb4f522-f8eb-403b-a921-a177787cc14d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:46.134071 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a5985d29-53fb-49de-94c2-aba9bb2df2c2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:46.134750 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a5985d29-53fb-49de-94c2-aba9bb2df2c2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:46.135525 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a5985d29-53fb-49de-94c2-aba9bb2df2c2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:46.135960 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a5985d29-53fb-49de-94c2-aba9bb2df2c2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:46.331468 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a5985d29-53fb-49de-94c2-aba9bb2df2c2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:46.335405 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-9bb4f522-f8eb-403b-a921-a177787cc14d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:46.340114 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a5985d29-53fb-49de-94c2-aba9bb2df2c2 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1677 microversion: 2.1 time: 0.217177 Aug 01 14:24:46.340698 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 272/532] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:46 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:24:46.343823 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-9bb4f522-f8eb-403b-a921-a177787cc14d tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 200 len: 1318 microversion: 2.1 time: 0.229227 Aug 01 14:24:46.344469 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 261/533] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:46 2022] GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:47.361822 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-cb62e2e3-608c-47b7-b439-544dc06559c3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:47.362437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-cb62e2e3-608c-47b7-b439-544dc06559c3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:47.365391 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3c568fdc-bb67-498c-9a30-f64c02ec1b13 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:47.367114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3c568fdc-bb67-498c-9a30-f64c02ec1b13 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:47.369274 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cb62e2e3-608c-47b7-b439-544dc06559c3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:47.369730 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cb62e2e3-608c-47b7-b439-544dc06559c3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:47.370537 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cb62e2e3-608c-47b7-b439-544dc06559c3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:47.370979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cb62e2e3-608c-47b7-b439-544dc06559c3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:47.373057 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3c568fdc-bb67-498c-9a30-f64c02ec1b13 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:47.373506 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3c568fdc-bb67-498c-9a30-f64c02ec1b13 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:47.374407 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3c568fdc-bb67-498c-9a30-f64c02ec1b13 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:47.374848 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3c568fdc-bb67-498c-9a30-f64c02ec1b13 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:47.579152 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-cb62e2e3-608c-47b7-b439-544dc06559c3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:47.579290 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3c568fdc-bb67-498c-9a30-f64c02ec1b13 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:47.584093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-cb62e2e3-608c-47b7-b439-544dc06559c3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1677 microversion: 2.1 time: 0.225422 Aug 01 14:24:47.584917 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 273/534] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:47 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:47.586827 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3c568fdc-bb67-498c-9a30-f64c02ec1b13 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 200 len: 1318 microversion: 2.1 time: 0.225875 Aug 01 14:24:47.587406 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 262/535] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:47 2022] GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:24:47.660139 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-dfc6536b-41f7-4ae7-bfd5-70a9cb779992 req-4da85cf4-50d0-402f-83a8-9465968c1996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "581ed715-d508-4de6-b1ba-8c7d089442b6", "name": "network-vif-plugged", "status": "completed", "tag": "42d37763-67b7-4c96-9d71-e893c62566f2"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:47.670529 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-dfc6536b-41f7-4ae7-bfd5-70a9cb779992 req-4da85cf4-50d0-402f-83a8-9465968c1996 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:47.671008 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-dfc6536b-41f7-4ae7-bfd5-70a9cb779992 req-4da85cf4-50d0-402f-83a8-9465968c1996 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:47.682936 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-dfc6536b-41f7-4ae7-bfd5-70a9cb779992 req-4da85cf4-50d0-402f-83a8-9465968c1996 service nova] Creating event network-vif-plugged:42d37763-67b7-4c96-9d71-e893c62566f2 for instance 581ed715-d508-4de6-b1ba-8c7d089442b6 on hv-cinder-78729 Aug 01 14:24:47.688096 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-dfc6536b-41f7-4ae7-bfd5-70a9cb779992 req-4da85cf4-50d0-402f-83a8-9465968c1996 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031574 Aug 01 14:24:47.693500 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 274/536] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:48.605680 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-760d213d-1109-457f-93c4-b667e5682bb3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:48.606329 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-760d213d-1109-457f-93c4-b667e5682bb3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:48.608010 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-94d9dcf4-3d0c-41b2-8cf0-4718a4f1ed46 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:48.608704 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-94d9dcf4-3d0c-41b2-8cf0-4718a4f1ed46 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:48.612854 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-760d213d-1109-457f-93c4-b667e5682bb3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:48.613380 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-760d213d-1109-457f-93c4-b667e5682bb3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:48.614435 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-760d213d-1109-457f-93c4-b667e5682bb3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:48.614858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-94d9dcf4-3d0c-41b2-8cf0-4718a4f1ed46 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:48.614988 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-760d213d-1109-457f-93c4-b667e5682bb3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:48.615316 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-94d9dcf4-3d0c-41b2-8cf0-4718a4f1ed46 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:48.616083 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-94d9dcf4-3d0c-41b2-8cf0-4718a4f1ed46 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:48.616521 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-94d9dcf4-3d0c-41b2-8cf0-4718a4f1ed46 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:48.634480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=100 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:48.700375 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=2 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:48.812160 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-94d9dcf4-3d0c-41b2-8cf0-4718a4f1ed46 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:48.815510 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-760d213d-1109-457f-93c4-b667e5682bb3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:48.820339 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-94d9dcf4-3d0c-41b2-8cf0-4718a4f1ed46 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 200 len: 1318 microversion: 2.1 time: 0.216395 Aug 01 14:24:48.820906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 275/537] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:48 2022] GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:24:48.823973 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-760d213d-1109-457f-93c4-b667e5682bb3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1677 microversion: 2.1 time: 0.222075 Aug 01 14:24:48.824667 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 263/538] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:48 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1677 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:49.841858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ecc73003-1ded-4dd7-9f9e-41ef01dade6a tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:49.842485 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ecc73003-1ded-4dd7-9f9e-41ef01dade6a tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:49.844281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ea48a1e4-d24d-44a8-aa16-ab33ca965f16 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:49.844694 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=8 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:49.845047 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ea48a1e4-d24d-44a8-aa16-ab33ca965f16 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:49.848378 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:49.849906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ecc73003-1ded-4dd7-9f9e-41ef01dade6a tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:49.850370 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ecc73003-1ded-4dd7-9f9e-41ef01dade6a tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:49.851152 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ecc73003-1ded-4dd7-9f9e-41ef01dade6a tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:49.851593 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ecc73003-1ded-4dd7-9f9e-41ef01dade6a tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:49.851866 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ea48a1e4-d24d-44a8-aa16-ab33ca965f16 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:49.852299 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ea48a1e4-d24d-44a8-aa16-ab33ca965f16 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:49.853190 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ea48a1e4-d24d-44a8-aa16-ab33ca965f16 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:49.853623 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ea48a1e4-d24d-44a8-aa16-ab33ca965f16 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:50.051969 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ecc73003-1ded-4dd7-9f9e-41ef01dade6a tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:50.055858 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ea48a1e4-d24d-44a8-aa16-ab33ca965f16 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:50.066390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ecc73003-1ded-4dd7-9f9e-41ef01dade6a tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 200 len: 1318 microversion: 2.1 time: 0.221754 Aug 01 14:24:50.066390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 276/539] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:49 2022] GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:50.066628 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ea48a1e4-d24d-44a8-aa16-ab33ca965f16 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1677 microversion: 2.1 time: 0.222833 Aug 01 14:24:50.066628 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 264/540] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:49 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1677 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:24:51.082146 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4cc76b7d-0870-4cca-b672-38e4e512e443 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:51.083175 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-4cc76b7d-0870-4cca-b672-38e4e512e443 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:51.086304 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-da9babe9-bda6-4980-ae3a-490baf05aa5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:51.086759 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-da9babe9-bda6-4980-ae3a-490baf05aa5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:51.089383 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4cc76b7d-0870-4cca-b672-38e4e512e443 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:51.089878 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4cc76b7d-0870-4cca-b672-38e4e512e443 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:51.090657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4cc76b7d-0870-4cca-b672-38e4e512e443 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:51.091101 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4cc76b7d-0870-4cca-b672-38e4e512e443 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:51.093422 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-da9babe9-bda6-4980-ae3a-490baf05aa5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:51.093901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-da9babe9-bda6-4980-ae3a-490baf05aa5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:51.094667 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-da9babe9-bda6-4980-ae3a-490baf05aa5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:51.095106 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-da9babe9-bda6-4980-ae3a-490baf05aa5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:51.284934 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4cc76b7d-0870-4cca-b672-38e4e512e443 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:51.289157 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-da9babe9-bda6-4980-ae3a-490baf05aa5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:51.292618 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4cc76b7d-0870-4cca-b672-38e4e512e443 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 200 len: 1506 microversion: 2.1 time: 0.214371 Aug 01 14:24:51.293203 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 277/541] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:51 2022] GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:51.296970 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-da9babe9-bda6-4980-ae3a-490baf05aa5d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1677 microversion: 2.1 time: 0.216405 Aug 01 14:24:51.297610 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 265/542] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:51 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:24:51.312691 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4cb6272e-f680-4fc8-b2f0-a1567de63382 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54027b24-54bd-4a3f-b399-bdbfa94e1919", "device": "/dev/sdb"}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:51.315657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-4cb6272e-f680-4fc8-b2f0-a1567de63382 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:51.322144 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4cb6272e-f680-4fc8-b2f0-a1567de63382 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:51.322682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4cb6272e-f680-4fc8-b2f0-a1567de63382 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:51.323485 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4cb6272e-f680-4fc8-b2f0-a1567de63382 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:51.323927 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4cb6272e-f680-4fc8-b2f0-a1567de63382 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:52.090159 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4cb6272e-f680-4fc8-b2f0-a1567de63382 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "POST /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.780639 Aug 01 14:24:52.090976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 278/543] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Aug 1 14:24:51 2022] POST /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6/os-volume_attachments => generated 194 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:24:52.318661 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-606b4287-d0ab-4ebb-a95e-3b20779f1183 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:52.319273 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-606b4287-d0ab-4ebb-a95e-3b20779f1183 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:52.325764 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-606b4287-d0ab-4ebb-a95e-3b20779f1183 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:52.326221 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-606b4287-d0ab-4ebb-a95e-3b20779f1183 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:52.326979 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-606b4287-d0ab-4ebb-a95e-3b20779f1183 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:52.327413 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-606b4287-d0ab-4ebb-a95e-3b20779f1183 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:52.458765 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-606b4287-d0ab-4ebb-a95e-3b20779f1183 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:52.466280 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-606b4287-d0ab-4ebb-a95e-3b20779f1183 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1677 microversion: 2.1 time: 0.151770 Aug 01 14:24:52.466810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 266/544] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:52 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:53.488827 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d6b81ccc-3275-4123-b0a2-cf1d505bd329 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:53.490540 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d6b81ccc-3275-4123-b0a2-cf1d505bd329 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:53.497258 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d6b81ccc-3275-4123-b0a2-cf1d505bd329 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:53.497545 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d6b81ccc-3275-4123-b0a2-cf1d505bd329 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:53.498321 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d6b81ccc-3275-4123-b0a2-cf1d505bd329 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:53.498755 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d6b81ccc-3275-4123-b0a2-cf1d505bd329 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:53.630620 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d6b81ccc-3275-4123-b0a2-cf1d505bd329 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:53.638074 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d6b81ccc-3275-4123-b0a2-cf1d505bd329 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1654 microversion: 2.1 time: 0.153939 Aug 01 14:24:53.638629 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 279/545] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:53 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:53.658553 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-691a3568-e67d-4c38-89da-cefdf745e020 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:53.665806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-691a3568-e67d-4c38-89da-cefdf745e020 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:53.666263 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-691a3568-e67d-4c38-89da-cefdf745e020 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:53.687877 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-691a3568-e67d-4c38-89da-cefdf745e020 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Going to try to start instance {{(pid=118246) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 14:24:53.846781 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-691a3568-e67d-4c38-89da-cefdf745e020 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "POST /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/action" status: 202 len: 0 microversion: 2.1 time: 0.191895 Aug 01 14:24:53.847382 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 267/546] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Aug 1 14:24:53 2022] POST /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:24:53.856751 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-53e6e679-90eb-40c7-8019-e4583aec4540 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:53.857368 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-53e6e679-90eb-40c7-8019-e4583aec4540 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:53.863327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-53e6e679-90eb-40c7-8019-e4583aec4540 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:53.863784 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-53e6e679-90eb-40c7-8019-e4583aec4540 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:53.864678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-53e6e679-90eb-40c7-8019-e4583aec4540 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:53.865123 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-53e6e679-90eb-40c7-8019-e4583aec4540 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:54.001135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-53e6e679-90eb-40c7-8019-e4583aec4540 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:54.009699 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-53e6e679-90eb-40c7-8019-e4583aec4540 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1663 microversion: 2.1 time: 0.156676 Aug 01 14:24:54.010319 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 280/547] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:53 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:24:55.033186 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e1099b02-c7b5-4629-9149-210667d6d483 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:55.033962 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e1099b02-c7b5-4629-9149-210667d6d483 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:55.040273 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e1099b02-c7b5-4629-9149-210667d6d483 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:55.040723 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e1099b02-c7b5-4629-9149-210667d6d483 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:55.041483 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e1099b02-c7b5-4629-9149-210667d6d483 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:55.041958 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e1099b02-c7b5-4629-9149-210667d6d483 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:55.171196 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e1099b02-c7b5-4629-9149-210667d6d483 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:55.178915 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e1099b02-c7b5-4629-9149-210667d6d483 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1663 microversion: 2.1 time: 0.150602 Aug 01 14:24:55.179487 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 268/548] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:55 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:56.200699 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d4d209c6-a001-4258-add6-1999e27a66da tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:24:56.201296 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d4d209c6-a001-4258-add6-1999e27a66da tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:56.208705 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d4d209c6-a001-4258-add6-1999e27a66da tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:56.209197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d4d209c6-a001-4258-add6-1999e27a66da tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:56.210056 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d4d209c6-a001-4258-add6-1999e27a66da tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:56.210501 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d4d209c6-a001-4258-add6-1999e27a66da tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:56.342220 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d4d209c6-a001-4258-add6-1999e27a66da tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:24:56.350703 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d4d209c6-a001-4258-add6-1999e27a66da tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1667 microversion: 2.1 time: 0.153839 Aug 01 14:24:56.351361 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 281/549] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:24:56 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:24:56.689571 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-9d393e29-a12a-4ab5-8381-7399c2689961 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afbfa596-f8eb-4ebf-a11a-4b7854a9f9cf"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:24:56.692593 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-9d393e29-a12a-4ab5-8381-7399c2689961 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:24:56.699355 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9d393e29-a12a-4ab5-8381-7399c2689961 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:56.699805 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9d393e29-a12a-4ab5-8381-7399c2689961 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:56.700565 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9d393e29-a12a-4ab5-8381-7399c2689961 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:24:56.701004 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9d393e29-a12a-4ab5-8381-7399c2689961 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:24:57.476807 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-9d393e29-a12a-4ab5-8381-7399c2689961 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "POST /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.790896 Aug 01 14:24:57.477532 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 269/550] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Aug 1 14:24:56 2022] POST /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-volume_attachments => generated 194 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:10.393482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-80a168e9-eff8-4815-8e16-915220aa61ac tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:10.395822 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-80a168e9-eff8-4815-8e16-915220aa61ac tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:10.399166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=21 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:10.399878 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:10.404642 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-80a168e9-eff8-4815-8e16-915220aa61ac tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:10.405095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-80a168e9-eff8-4815-8e16-915220aa61ac tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:10.405892 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-80a168e9-eff8-4815-8e16-915220aa61ac tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:10.406332 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-80a168e9-eff8-4815-8e16-915220aa61ac tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:10.429528 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-80a168e9-eff8-4815-8e16-915220aa61ac tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lazy-loading 'flavor' on Instance uuid eff34e0e-c728-4ffb-8eba-169ede959890 {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:25:10.798066 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-80a168e9-eff8-4815-8e16-915220aa61ac tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "POST /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/action" status: 200 len: 32 microversion: 2.1 time: 0.408400 Aug 01 14:25:10.798797 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 282/551] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Aug 1 14:25:10 2022] POST /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/action => generated 32 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:25:10.806200 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=11 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:10.807040 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:10.811878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-cea2614b-7865-4b81-b3b3-b4c3a19078c2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:10.812597 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-cea2614b-7865-4b81-b3b3-b4c3a19078c2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:10.819756 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cea2614b-7865-4b81-b3b3-b4c3a19078c2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:10.820475 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cea2614b-7865-4b81-b3b3-b4c3a19078c2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:10.821695 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cea2614b-7865-4b81-b3b3-b4c3a19078c2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:10.822175 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cea2614b-7865-4b81-b3b3-b4c3a19078c2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:10.964116 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-cea2614b-7865-4b81-b3b3-b4c3a19078c2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:10.972417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-cea2614b-7865-4b81-b3b3-b4c3a19078c2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1735 microversion: 2.1 time: 0.167719 Aug 01 14:25:10.973056 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 270/552] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:10 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:11.995289 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-9022e8c5-a25c-437d-88f2-784bdefea413 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:11.995907 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-9022e8c5-a25c-437d-88f2-784bdefea413 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:12.002685 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9022e8c5-a25c-437d-88f2-784bdefea413 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:12.007113 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9022e8c5-a25c-437d-88f2-784bdefea413 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:12.007113 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9022e8c5-a25c-437d-88f2-784bdefea413 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:12.007113 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9022e8c5-a25c-437d-88f2-784bdefea413 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:12.140620 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-9022e8c5-a25c-437d-88f2-784bdefea413 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:12.148618 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-9022e8c5-a25c-437d-88f2-784bdefea413 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1735 microversion: 2.1 time: 0.158059 Aug 01 14:25:12.149277 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 283/553] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:11 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:13.094376 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d7572cbd-ef9d-4277-ae31-dfd2da59967e tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:13.094884 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d7572cbd-ef9d-4277-ae31-dfd2da59967e tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:13.101248 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d7572cbd-ef9d-4277-ae31-dfd2da59967e tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:13.102393 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d7572cbd-ef9d-4277-ae31-dfd2da59967e tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:13.103158 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d7572cbd-ef9d-4277-ae31-dfd2da59967e tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:13.103597 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d7572cbd-ef9d-4277-ae31-dfd2da59967e tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:13.170521 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e5559e63-b9a2-49b4-8461-8a2d802b4366 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:13.171135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e5559e63-b9a2-49b4-8461-8a2d802b4366 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:13.177633 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e5559e63-b9a2-49b4-8461-8a2d802b4366 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:13.178183 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e5559e63-b9a2-49b4-8461-8a2d802b4366 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:13.178960 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e5559e63-b9a2-49b4-8461-8a2d802b4366 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:13.179407 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e5559e63-b9a2-49b4-8461-8a2d802b4366 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:13.184705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-d7572cbd-ef9d-4277-ae31-dfd2da59967e tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lazy-loading 'services' on Instance uuid 581ed715-d508-4de6-b1ba-8c7d089442b6 {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:25:13.307998 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e5559e63-b9a2-49b4-8461-8a2d802b4366 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:13.316228 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e5559e63-b9a2-49b4-8461-8a2d802b4366 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1735 microversion: 2.1 time: 0.149202 Aug 01 14:25:13.316787 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 284/554] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:13 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:13.444420 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d7572cbd-ef9d-4277-ae31-dfd2da59967e tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "DELETE /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6/os-volume_attachments/54027b24-54bd-4a3f-b399-bdbfa94e1919" status: 202 len: 0 microversion: 2.1 time: 0.353725 Aug 01 14:25:13.445012 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 271/555] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Aug 1 14:25:13 2022] DELETE /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6/os-volume_attachments/54027b24-54bd-4a3f-b399-bdbfa94e1919 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:25:14.339393 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3795a9bb-be6c-41d7-b2ac-742ab5703fb4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:14.339999 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3795a9bb-be6c-41d7-b2ac-742ab5703fb4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:14.346445 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3795a9bb-be6c-41d7-b2ac-742ab5703fb4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:14.346893 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3795a9bb-be6c-41d7-b2ac-742ab5703fb4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:14.347650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3795a9bb-be6c-41d7-b2ac-742ab5703fb4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:14.348083 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3795a9bb-be6c-41d7-b2ac-742ab5703fb4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:14.479218 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3795a9bb-be6c-41d7-b2ac-742ab5703fb4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:14.487091 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3795a9bb-be6c-41d7-b2ac-742ab5703fb4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1735 microversion: 2.1 time: 0.152502 Aug 01 14:25:14.487653 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 285/556] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:14 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:15.510131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1ed0c33f-dbd5-46e7-b0ef-3b7c0eb89d95 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:15.510830 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-1ed0c33f-dbd5-46e7-b0ef-3b7c0eb89d95 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:15.516999 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1ed0c33f-dbd5-46e7-b0ef-3b7c0eb89d95 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:15.517448 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1ed0c33f-dbd5-46e7-b0ef-3b7c0eb89d95 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:15.518243 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1ed0c33f-dbd5-46e7-b0ef-3b7c0eb89d95 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:15.518687 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1ed0c33f-dbd5-46e7-b0ef-3b7c0eb89d95 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:15.621196 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-fed2bf0f-60a2-4da8-b755-48b41a713cb0 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:15.621772 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-fed2bf0f-60a2-4da8-b755-48b41a713cb0 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:15.628206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fed2bf0f-60a2-4da8-b755-48b41a713cb0 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:15.628659 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fed2bf0f-60a2-4da8-b755-48b41a713cb0 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:15.629436 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fed2bf0f-60a2-4da8-b755-48b41a713cb0 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:15.629912 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fed2bf0f-60a2-4da8-b755-48b41a713cb0 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:15.651588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-1ed0c33f-dbd5-46e7-b0ef-3b7c0eb89d95 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:15.656642 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-fed2bf0f-60a2-4da8-b755-48b41a713cb0 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Going to try to terminate instance {{(pid=118247) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:25:15.660151 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-1ed0c33f-dbd5-46e7-b0ef-3b7c0eb89d95 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1735 microversion: 2.1 time: 0.155256 Aug 01 14:25:15.660783 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 272/557] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:15 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:15.919357 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-fed2bf0f-60a2-4da8-b755-48b41a713cb0 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "DELETE /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 204 len: 0 microversion: 2.1 time: 0.302160 Aug 01 14:25:15.919941 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 286/558] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:25:15 2022] DELETE /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:25:15.928075 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-879d07a8-23fc-4417-ae1f-30ec0ec9f62c tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:15.928679 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-879d07a8-23fc-4417-ae1f-30ec0ec9f62c tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:15.939782 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-879d07a8-23fc-4417-ae1f-30ec0ec9f62c tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:15.939782 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-879d07a8-23fc-4417-ae1f-30ec0ec9f62c tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:15.939782 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-879d07a8-23fc-4417-ae1f-30ec0ec9f62c tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:15.939782 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-879d07a8-23fc-4417-ae1f-30ec0ec9f62c tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:16.067445 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-879d07a8-23fc-4417-ae1f-30ec0ec9f62c tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:16.075080 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-879d07a8-23fc-4417-ae1f-30ec0ec9f62c tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 200 len: 1512 microversion: 2.1 time: 0.150813 Aug 01 14:25:16.075642 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 273/559] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:15 2022] GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:16.682458 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d78431b8-4a4c-4792-9992-217a246af597 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:16.683145 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d78431b8-4a4c-4792-9992-217a246af597 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:16.689521 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d78431b8-4a4c-4792-9992-217a246af597 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:16.690007 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d78431b8-4a4c-4792-9992-217a246af597 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:16.690777 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d78431b8-4a4c-4792-9992-217a246af597 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:16.691217 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d78431b8-4a4c-4792-9992-217a246af597 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:16.823347 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d78431b8-4a4c-4792-9992-217a246af597 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:16.831489 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d78431b8-4a4c-4792-9992-217a246af597 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1735 microversion: 2.1 time: 0.153800 Aug 01 14:25:16.832069 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 287/560] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:16 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:17.095608 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e0b18e3b-ede6-4eca-91e9-a346b3e1f7c3 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:17.096229 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e0b18e3b-ede6-4eca-91e9-a346b3e1f7c3 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:17.103468 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e0b18e3b-ede6-4eca-91e9-a346b3e1f7c3 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:17.103924 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e0b18e3b-ede6-4eca-91e9-a346b3e1f7c3 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:17.104696 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e0b18e3b-ede6-4eca-91e9-a346b3e1f7c3 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:17.105136 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e0b18e3b-ede6-4eca-91e9-a346b3e1f7c3 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:17.231179 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e0b18e3b-ede6-4eca-91e9-a346b3e1f7c3 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:17.238802 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e0b18e3b-ede6-4eca-91e9-a346b3e1f7c3 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 200 len: 1512 microversion: 2.1 time: 0.147041 Aug 01 14:25:17.239369 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 274/561] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:17 2022] GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:17.854623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7550a83a-86bd-4263-a4d9-b4ec42301e6b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:17.855227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7550a83a-86bd-4263-a4d9-b4ec42301e6b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:17.861597 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7550a83a-86bd-4263-a4d9-b4ec42301e6b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:17.862076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7550a83a-86bd-4263-a4d9-b4ec42301e6b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:17.862842 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7550a83a-86bd-4263-a4d9-b4ec42301e6b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:17.863274 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7550a83a-86bd-4263-a4d9-b4ec42301e6b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:17.995642 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7550a83a-86bd-4263-a4d9-b4ec42301e6b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:18.003762 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7550a83a-86bd-4263-a4d9-b4ec42301e6b tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1735 microversion: 2.1 time: 0.152904 Aug 01 14:25:18.004349 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 288/562] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:17 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:18.261108 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-81df1a69-293a-4a86-b79b-6c92336a2527 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:18.261677 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-81df1a69-293a-4a86-b79b-6c92336a2527 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:18.268339 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-81df1a69-293a-4a86-b79b-6c92336a2527 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:18.268787 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-81df1a69-293a-4a86-b79b-6c92336a2527 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:18.269561 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-81df1a69-293a-4a86-b79b-6c92336a2527 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:18.270025 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-81df1a69-293a-4a86-b79b-6c92336a2527 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:18.404553 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-81df1a69-293a-4a86-b79b-6c92336a2527 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:18.412789 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-81df1a69-293a-4a86-b79b-6c92336a2527 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 200 len: 1512 microversion: 2.1 time: 0.156138 Aug 01 14:25:18.413358 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 275/563] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:18 2022] GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:18.433207 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-ba97fce8-bdb0-4c56-97a2-d4df75bf1386 req-00a1e540-32d4-4c02-95dd-20b1b4a36053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "581ed715-d508-4de6-b1ba-8c7d089442b6", "name": "network-vif-deleted", "tag": "42d37763-67b7-4c96-9d71-e893c62566f2"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:18.442993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-ba97fce8-bdb0-4c56-97a2-d4df75bf1386 req-00a1e540-32d4-4c02-95dd-20b1b4a36053 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:18.443439 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-ba97fce8-bdb0-4c56-97a2-d4df75bf1386 req-00a1e540-32d4-4c02-95dd-20b1b4a36053 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:18.455016 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-ba97fce8-bdb0-4c56-97a2-d4df75bf1386 req-00a1e540-32d4-4c02-95dd-20b1b4a36053 service nova] Creating event network-vif-deleted:42d37763-67b7-4c96-9d71-e893c62566f2 for instance 581ed715-d508-4de6-b1ba-8c7d089442b6 on hv-cinder-78729 Aug 01 14:25:18.459918 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-ba97fce8-bdb0-4c56-97a2-d4df75bf1386 req-00a1e540-32d4-4c02-95dd-20b1b4a36053 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030681 Aug 01 14:25:18.460608 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 289/564] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:19.025972 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-07988184-6f42-4eb6-94bc-85345c2e71d4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:19.026522 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-07988184-6f42-4eb6-94bc-85345c2e71d4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:19.032536 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-07988184-6f42-4eb6-94bc-85345c2e71d4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:19.032986 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-07988184-6f42-4eb6-94bc-85345c2e71d4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:19.033776 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-07988184-6f42-4eb6-94bc-85345c2e71d4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:19.034216 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-07988184-6f42-4eb6-94bc-85345c2e71d4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:19.167008 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-07988184-6f42-4eb6-94bc-85345c2e71d4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:19.174878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-07988184-6f42-4eb6-94bc-85345c2e71d4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1735 microversion: 2.1 time: 0.153551 Aug 01 14:25:19.175453 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 276/565] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:19 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:19.436184 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-92639bf2-1079-4249-9c43-b99eefff9925 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:19.436884 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-92639bf2-1079-4249-9c43-b99eefff9925 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:19.443155 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-92639bf2-1079-4249-9c43-b99eefff9925 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:19.443606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-92639bf2-1079-4249-9c43-b99eefff9925 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:19.444409 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-92639bf2-1079-4249-9c43-b99eefff9925 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:19.444848 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-92639bf2-1079-4249-9c43-b99eefff9925 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:19.476870 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-92639bf2-1079-4249-9c43-b99eefff9925 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:19.477261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-92639bf2-1079-4249-9c43-b99eefff9925 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:19.477735 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-92639bf2-1079-4249-9c43-b99eefff9925 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lazy-loading 'fault' on Instance uuid 581ed715-d508-4de6-b1ba-8c7d089442b6 {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:25:19.519458 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-92639bf2-1079-4249-9c43-b99eefff9925 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0097e07390144f3a804eb5057c6b75e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714cc98080ae4baaa11b8b946c67ba2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:19.527644 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-92639bf2-1079-4249-9c43-b99eefff9925 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 200 len: 1308 microversion: 2.1 time: 0.096556 Aug 01 14:25:19.528213 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 290/566] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:19 2022] GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:20.195740 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8bd9f955-23e2-46b2-ab72-da505b6284ed tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:20.196862 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8bd9f955-23e2-46b2-ab72-da505b6284ed tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:20.203462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8bd9f955-23e2-46b2-ab72-da505b6284ed tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:20.203908 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8bd9f955-23e2-46b2-ab72-da505b6284ed tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:20.204665 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8bd9f955-23e2-46b2-ab72-da505b6284ed tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:20.205102 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8bd9f955-23e2-46b2-ab72-da505b6284ed tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:20.335599 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8bd9f955-23e2-46b2-ab72-da505b6284ed tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:20.343875 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8bd9f955-23e2-46b2-ab72-da505b6284ed tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1735 microversion: 2.1 time: 0.151964 Aug 01 14:25:20.344442 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 277/567] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:20 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:20.548543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-914e8566-9d06-4d86-af51-c2364f3007f1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:20.549086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-914e8566-9d06-4d86-af51-c2364f3007f1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] [instance: 581ed715-d508-4de6-b1ba-8c7d089442b6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:20.555823 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-914e8566-9d06-4d86-af51-c2364f3007f1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:20.556278 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-914e8566-9d06-4d86-af51-c2364f3007f1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:20.557048 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-914e8566-9d06-4d86-af51-c2364f3007f1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:20.557495 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-914e8566-9d06-4d86-af51-c2364f3007f1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:20.570770 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-914e8566-9d06-4d86-af51-c2364f3007f1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] HTTP exception thrown: Instance 581ed715-d508-4de6-b1ba-8c7d089442b6 could not be found. Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-914e8566-9d06-4d86-af51-c2364f3007f1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Request method failure captured: Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 HTTP/1.1 Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-Gs50FDoprjvGZBBcBoG-icKc9wRgOgNNgeZT64aSL4fV4wf1Q8sODtoaWXXHyHKdUzibcJ33yjWZn5vpMWBx5n7htvxLA_NzQMDfNJEsqIYPuywBe5hM1pFKysaLVScjJKC2Fqq3dW7bMVtp4cqRLPrgjQwj4b066WM_IHNmc9M7Y Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: 714cc98080ae4baaa11b8b946c67ba2c Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-VolumesSnapshotTestJSON-849995764 Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:25:20.572496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:25:20.574080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/714cc98080ae4baaa11b8b946c67ba2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_714cc98080ae4baaa11b8b946c67ba2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/714cc98080ae4baaa11b8b946c67ba2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/714cc98080ae4baaa11b8b946c67ba2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:25:20.574080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-VolumesSnapshotTestJSON-849995764 Aug 01 14:25:20.574080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: 714cc98080ae4baaa11b8b946c67ba2c Aug 01 14:25:20.574080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-849995764 Aug 01 14:25:20.574080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-VolumesSnapshotTestJSON-849995764-project Aug 01 14:25:20.574080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:25:20.574080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:25:20.574080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: 0097e07390144f3a804eb5057c6b75e5 Aug 01 14:25:20.574080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-VolumesSnapshotTestJSON-849995764-project Aug 01 14:25:20.574080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:25:20.574080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 581ed715-d508-4de6-b1ba-8c7d089442b6 could not be found. Aug 01 14:25:20.574080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '581ed715-d508-4de6-b1ba-8c7d089442b6'} Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 581ed715-d508-4de6-b1ba-8c7d089442b6 could not be found. Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:25:20.574977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 581ed715-d508-4de6-b1ba-8c7d089442b6 could not be found. Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 581ed715-d508-4de6-b1ba-8c7d089442b6 could not be found. Aug 01 14:25:20.576455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:25:20.577690 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-914e8566-9d06-4d86-af51-c2364f3007f1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] Returning 404 to user: Instance 581ed715-d508-4de6-b1ba-8c7d089442b6 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:25:20.577690 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-914e8566-9d06-4d86-af51-c2364f3007f1 tempest-VolumesSnapshotTestJSON-849995764 tempest-VolumesSnapshotTestJSON-849995764-project] 10.222.0.49 "GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6" status: 404 len: 111 microversion: 2.1 time: 0.029301 Aug 01 14:25:20.577690 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 291/568] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:20 2022] GET /compute/v2.1/servers/581ed715-d508-4de6-b1ba-8c7d089442b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:25:21.364479 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d3dc987b-b61b-43f0-b9bc-a1190699f094 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:21.365118 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d3dc987b-b61b-43f0-b9bc-a1190699f094 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:21.372671 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d3dc987b-b61b-43f0-b9bc-a1190699f094 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:21.373129 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d3dc987b-b61b-43f0-b9bc-a1190699f094 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:21.373946 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d3dc987b-b61b-43f0-b9bc-a1190699f094 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:21.374399 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d3dc987b-b61b-43f0-b9bc-a1190699f094 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:21.510327 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d3dc987b-b61b-43f0-b9bc-a1190699f094 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:21.518430 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d3dc987b-b61b-43f0-b9bc-a1190699f094 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1735 microversion: 2.1 time: 0.157813 Aug 01 14:25:21.519015 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 278/569] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:21 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:22.540146 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f2fe075c-ae58-485f-8b70-fc091ad4b870 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:22.540767 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f2fe075c-ae58-485f-8b70-fc091ad4b870 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:22.546879 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f2fe075c-ae58-485f-8b70-fc091ad4b870 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:22.551929 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f2fe075c-ae58-485f-8b70-fc091ad4b870 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:22.551929 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f2fe075c-ae58-485f-8b70-fc091ad4b870 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:22.551929 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f2fe075c-ae58-485f-8b70-fc091ad4b870 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:22.676203 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f2fe075c-ae58-485f-8b70-fc091ad4b870 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:22.685869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f2fe075c-ae58-485f-8b70-fc091ad4b870 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1735 microversion: 2.1 time: 0.149718 Aug 01 14:25:22.686433 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 292/570] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:22 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:23.708488 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e3f9f3bd-c46b-4cf0-bd7c-39d48975024e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:23.709097 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e3f9f3bd-c46b-4cf0-bd7c-39d48975024e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:23.716452 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e3f9f3bd-c46b-4cf0-bd7c-39d48975024e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:23.716903 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e3f9f3bd-c46b-4cf0-bd7c-39d48975024e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:23.717670 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e3f9f3bd-c46b-4cf0-bd7c-39d48975024e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:23.718137 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e3f9f3bd-c46b-4cf0-bd7c-39d48975024e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:23.849045 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e3f9f3bd-c46b-4cf0-bd7c-39d48975024e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:23.857683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e3f9f3bd-c46b-4cf0-bd7c-39d48975024e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1735 microversion: 2.1 time: 0.153052 Aug 01 14:25:23.858300 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 279/571] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:23 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:24.878985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1e89c1d3-ee06-41c2-a1c9-beb5a50ef2a7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:24.879592 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1e89c1d3-ee06-41c2-a1c9-beb5a50ef2a7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:24.886137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1e89c1d3-ee06-41c2-a1c9-beb5a50ef2a7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:24.887122 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1e89c1d3-ee06-41c2-a1c9-beb5a50ef2a7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:24.887894 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1e89c1d3-ee06-41c2-a1c9-beb5a50ef2a7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:24.888331 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1e89c1d3-ee06-41c2-a1c9-beb5a50ef2a7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:25.015541 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1e89c1d3-ee06-41c2-a1c9-beb5a50ef2a7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:25.023340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1e89c1d3-ee06-41c2-a1c9-beb5a50ef2a7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1735 microversion: 2.1 time: 0.148173 Aug 01 14:25:25.023895 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 293/572] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:24 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:26.045434 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-28106c4c-9929-4dbb-ab6a-055ec5191370 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:26.046070 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-28106c4c-9929-4dbb-ab6a-055ec5191370 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:26.052472 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-28106c4c-9929-4dbb-ab6a-055ec5191370 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:26.052921 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-28106c4c-9929-4dbb-ab6a-055ec5191370 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:26.053677 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-28106c4c-9929-4dbb-ab6a-055ec5191370 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:26.054256 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-28106c4c-9929-4dbb-ab6a-055ec5191370 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:26.335611 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-28106c4c-9929-4dbb-ab6a-055ec5191370 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:26.343725 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-28106c4c-9929-4dbb-ab6a-055ec5191370 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1735 microversion: 2.1 time: 0.302202 Aug 01 14:25:26.344299 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 280/573] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:26 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1735 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:26.533558 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-91d158fc-8ae3-428d-a3ae-c8dbac4fd4cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:26.534151 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-91d158fc-8ae3-428d-a3ae-c8dbac4fd4cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:26.540899 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-91d158fc-8ae3-428d-a3ae-c8dbac4fd4cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:26.541358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-91d158fc-8ae3-428d-a3ae-c8dbac4fd4cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:26.542191 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-91d158fc-8ae3-428d-a3ae-c8dbac4fd4cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:26.542667 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-91d158fc-8ae3-428d-a3ae-c8dbac4fd4cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:26.571356 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-91d158fc-8ae3-428d-a3ae-c8dbac4fd4cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/os-volume_attachments/ad71f725-4305-44cc-9a03-cb739b938516" status: 200 len: 194 microversion: 2.20 time: 0.041726 Aug 01 14:25:26.571941 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 294/574] 10.222.0.49 () {60 vars in 1454 bytes} [Mon Aug 1 14:25:26 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/os-volume_attachments/ad71f725-4305-44cc-9a03-cb739b938516 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:25:26.640400 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b14d21db-2fcd-48ef-b227-2bca1a17163b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:26.641016 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b14d21db-2fcd-48ef-b227-2bca1a17163b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:26.647296 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b14d21db-2fcd-48ef-b227-2bca1a17163b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:26.647744 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b14d21db-2fcd-48ef-b227-2bca1a17163b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:26.648503 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b14d21db-2fcd-48ef-b227-2bca1a17163b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:26.648939 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b14d21db-2fcd-48ef-b227-2bca1a17163b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:26.755598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-b14d21db-2fcd-48ef-b227-2bca1a17163b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lazy-loading 'services' on Instance uuid 9c41c564-40f2-47cf-820b-915c3d43ccb3 {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:25:26.962532 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b14d21db-2fcd-48ef-b227-2bca1a17163b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/os-volume_attachments/ad71f725-4305-44cc-9a03-cb739b938516" status: 202 len: 0 microversion: 2.20 time: 0.326547 Aug 01 14:25:26.963127 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 281/575] 10.222.0.49 () {60 vars in 1457 bytes} [Mon Aug 1 14:25:26 2022] DELETE /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/os-volume_attachments/ad71f725-4305-44cc-9a03-cb739b938516 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:25:26.972257 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f0c2215e-f6a2-42c2-94e6-9bf9efdfd2cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:26.974514 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f0c2215e-f6a2-42c2-94e6-9bf9efdfd2cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:26.981708 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f0c2215e-f6a2-42c2-94e6-9bf9efdfd2cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:26.983099 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f0c2215e-f6a2-42c2-94e6-9bf9efdfd2cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:26.983099 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f0c2215e-f6a2-42c2-94e6-9bf9efdfd2cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:26.983454 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f0c2215e-f6a2-42c2-94e6-9bf9efdfd2cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:27.011204 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:27.016496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f0c2215e-f6a2-42c2-94e6-9bf9efdfd2cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048189 Aug 01 14:25:27.017046 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 295/576] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Aug 1 14:25:26 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:25:27.366180 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-31f4b171-e72a-48b0-a142-64c462338cfb tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:27.367137 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-31f4b171-e72a-48b0-a142-64c462338cfb tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:27.373424 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-31f4b171-e72a-48b0-a142-64c462338cfb tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:27.373909 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-31f4b171-e72a-48b0-a142-64c462338cfb tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:27.374692 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-31f4b171-e72a-48b0-a142-64c462338cfb tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:27.375137 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-31f4b171-e72a-48b0-a142-64c462338cfb tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:27.511217 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-31f4b171-e72a-48b0-a142-64c462338cfb tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:27.519614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-31f4b171-e72a-48b0-a142-64c462338cfb tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1715 microversion: 2.1 time: 0.158131 Aug 01 14:25:27.520186 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 282/577] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:27 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:27.631087 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1ab504ec-8f26-4126-8d19-b51c5b07311e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:27.631613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1ab504ec-8f26-4126-8d19-b51c5b07311e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:27.639834 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1ab504ec-8f26-4126-8d19-b51c5b07311e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:27.640279 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1ab504ec-8f26-4126-8d19-b51c5b07311e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:27.641041 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1ab504ec-8f26-4126-8d19-b51c5b07311e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:27.641475 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1ab504ec-8f26-4126-8d19-b51c5b07311e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:27.830985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-1ab504ec-8f26-4126-8d19-b51c5b07311e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] HTTP exception thrown: Cannot 'detach_volume' instance eff34e0e-c728-4ffb-8eba-169ede959890 while it is in vm_state rescued Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1ab504ec-8f26-4126-8d19-b51c5b07311e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Request method failure captured: Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: DELETE /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-volume_attachments/afbfa596-f8eb-4ebf-a11a-4b7854a9f9cf HTTP/1.1 Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-E4_d12P1yLmeAi6iRzWLrJoqCmtM2x-aOg__n743TyqbmpKOWkckS8c7k87mJ7g9R1SSYLqx8F7V6s4r-ccgea6VgW8gApwCdGP9EruZPZ0fjTAqXY6MSyeImK19uptwGcDBuAzC8kp39QF0SDqE5zKBuWPoWoccfhbA-KPOePrK4 Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: c80bd4eb290541d8a713ea5ba60d0de4 Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1518303562 Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:25:27.832482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:25:27.834118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:25:27.834118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1518303562 Aug 01 14:25:27.834118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: c80bd4eb290541d8a713ea5ba60d0de4 Aug 01 14:25:27.834118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1518303562 Aug 01 14:25:27.834118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-ServerRescueNegativeTestJSON-1518303562-project Aug 01 14:25:27.834118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:25:27.834118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:25:27.834118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: 6b46ac5a29594c41a83e70838b0a13c8 Aug 01 14:25:27.834118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1518303562-project Aug 01 14:25:27.834118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:25:27.834118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Cannot 'detach_volume' instance eff34e0e-c728-4ffb-8eba-169ede959890 while it is in vm_state rescued Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'server_id': 'eff34e0e-c728-4ffb-8eba-169ede959890', 'id': 'afbfa596-f8eb-4ebf-a11a-4b7854a9f9cf'} Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eff34e0e-c728-4ffb-8eba-169ede959890 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:25:27.834993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:25:27.836682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 01 14:25:27.836682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 14:25:27.836682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 14:25:27.836682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 14:25:27.836682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance eff34e0e-c728-4ffb-8eba-169ede959890 while it is in vm_state rescued Aug 01 14:25:27.836682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:25:27.836682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:25:27.836682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:25:27.836682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:27.836682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:25:27.836682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:25:27.836682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:25:27.836682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:25:27.836682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance eff34e0e-c728-4ffb-8eba-169ede959890 while it is in vm_state rescued Aug 01 14:25:27.836682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:25:27.836682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1ab504ec-8f26-4126-8d19-b51c5b07311e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Returning 409 to user: Cannot 'detach_volume' instance eff34e0e-c728-4ffb-8eba-169ede959890 while it is in vm_state rescued {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:25:27.837993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1ab504ec-8f26-4126-8d19-b51c5b07311e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "DELETE /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-volume_attachments/afbfa596-f8eb-4ebf-a11a-4b7854a9f9cf" status: 409 len: 152 microversion: 2.1 time: 0.206774 Aug 01 14:25:27.837993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 296/578] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Aug 1 14:25:27 2022] DELETE /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-volume_attachments/afbfa596-f8eb-4ebf-a11a-4b7854a9f9cf => generated 152 bytes in 208 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 14:25:27.842863 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0b2e24f2-c2be-42ca-8215-115464ae7fb2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:27.843423 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0b2e24f2-c2be-42ca-8215-115464ae7fb2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:27.849405 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0b2e24f2-c2be-42ca-8215-115464ae7fb2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:27.849888 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0b2e24f2-c2be-42ca-8215-115464ae7fb2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:27.850652 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0b2e24f2-c2be-42ca-8215-115464ae7fb2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:27.851092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0b2e24f2-c2be-42ca-8215-115464ae7fb2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:28.007827 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0b2e24f2-c2be-42ca-8215-115464ae7fb2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "POST /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/action" status: 202 len: 0 microversion: 2.1 time: 0.168626 Aug 01 14:25:28.009125 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 283/579] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Aug 1 14:25:27 2022] POST /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:25:28.017372 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-709c3d6a-eb0f-4957-8e85-d5165fa86792 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:28.020591 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-709c3d6a-eb0f-4957-8e85-d5165fa86792 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:28.024267 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-709c3d6a-eb0f-4957-8e85-d5165fa86792 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:28.024714 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-709c3d6a-eb0f-4957-8e85-d5165fa86792 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:28.025531 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-709c3d6a-eb0f-4957-8e85-d5165fa86792 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:28.025993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-709c3d6a-eb0f-4957-8e85-d5165fa86792 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:28.029450 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d43f9133-e715-4eaf-8d96-edc4555414cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:28.031827 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d43f9133-e715-4eaf-8d96-edc4555414cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:28.038003 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d43f9133-e715-4eaf-8d96-edc4555414cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:28.038457 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d43f9133-e715-4eaf-8d96-edc4555414cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:28.039223 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d43f9133-e715-4eaf-8d96-edc4555414cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:28.039663 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d43f9133-e715-4eaf-8d96-edc4555414cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:28.043389 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:28.070682 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d43f9133-e715-4eaf-8d96-edc4555414cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045905 Aug 01 14:25:28.071257 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 284/580] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Aug 1 14:25:28 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:25:28.156750 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-709c3d6a-eb0f-4957-8e85-d5165fa86792 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:28.165972 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-709c3d6a-eb0f-4957-8e85-d5165fa86792 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1723 microversion: 2.1 time: 0.152315 Aug 01 14:25:28.166537 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 297/581] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:28 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:29.083925 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-80cfac88-2312-4a47-a23a-4e5fa320dba0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:29.086101 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-80cfac88-2312-4a47-a23a-4e5fa320dba0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:29.093871 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-80cfac88-2312-4a47-a23a-4e5fa320dba0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:29.094325 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-80cfac88-2312-4a47-a23a-4e5fa320dba0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:29.095085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-80cfac88-2312-4a47-a23a-4e5fa320dba0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:29.095518 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-80cfac88-2312-4a47-a23a-4e5fa320dba0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:29.125296 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-80cfac88-2312-4a47-a23a-4e5fa320dba0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046084 Aug 01 14:25:29.126118 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 285/582] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Aug 1 14:25:29 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:29.188971 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0b06bd95-abe6-46b9-9c76-f3cc2a106156 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:29.189589 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0b06bd95-abe6-46b9-9c76-f3cc2a106156 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:29.192404 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-9fbec77e-f154-4769-969f-d3f28784b81c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:29.192910 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-9fbec77e-f154-4769-969f-d3f28784b81c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:29.196173 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b06bd95-abe6-46b9-9c76-f3cc2a106156 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:29.196629 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b06bd95-abe6-46b9-9c76-f3cc2a106156 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:29.197452 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b06bd95-abe6-46b9-9c76-f3cc2a106156 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:29.197933 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b06bd95-abe6-46b9-9c76-f3cc2a106156 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:29.199390 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9fbec77e-f154-4769-969f-d3f28784b81c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:29.202137 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9fbec77e-f154-4769-969f-d3f28784b81c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:29.202137 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9fbec77e-f154-4769-969f-d3f28784b81c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:29.202137 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9fbec77e-f154-4769-969f-d3f28784b81c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:29.227286 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-9fbec77e-f154-4769-969f-d3f28784b81c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Going to try to terminate instance {{(pid=118246) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:25:29.329534 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0b06bd95-abe6-46b9-9c76-f3cc2a106156 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:29.337591 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0b06bd95-abe6-46b9-9c76-f3cc2a106156 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1723 microversion: 2.1 time: 0.153607 Aug 01 14:25:29.338186 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 298/583] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:29 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:29.540423 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-9fbec77e-f154-4769-969f-d3f28784b81c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 204 len: 0 microversion: 2.20 time: 0.352287 Aug 01 14:25:29.541019 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 286/584] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Aug 1 14:25:29 2022] DELETE /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 01 14:25:29.554017 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d01a5483-42ec-4ad6-a716-6124639b4f08 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:29.554620 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d01a5483-42ec-4ad6-a716-6124639b4f08 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:29.561428 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d01a5483-42ec-4ad6-a716-6124639b4f08 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:29.562092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d01a5483-42ec-4ad6-a716-6124639b4f08 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:29.562945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d01a5483-42ec-4ad6-a716-6124639b4f08 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:29.563381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d01a5483-42ec-4ad6-a716-6124639b4f08 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:29.694743 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d01a5483-42ec-4ad6-a716-6124639b4f08 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:29.703144 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d01a5483-42ec-4ad6-a716-6124639b4f08 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:29.704650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d01a5483-42ec-4ad6-a716-6124639b4f08 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:29.705835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d01a5483-42ec-4ad6-a716-6124639b4f08 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.155905 Aug 01 14:25:29.706397 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 299/585] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:29 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:30.360041 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b02b6fb1-945b-4ebe-8d85-a629d36bf518 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:30.360739 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b02b6fb1-945b-4ebe-8d85-a629d36bf518 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:30.367530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b02b6fb1-945b-4ebe-8d85-a629d36bf518 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:30.367979 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b02b6fb1-945b-4ebe-8d85-a629d36bf518 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:30.368742 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b02b6fb1-945b-4ebe-8d85-a629d36bf518 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:30.369181 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b02b6fb1-945b-4ebe-8d85-a629d36bf518 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:30.501363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-b02b6fb1-945b-4ebe-8d85-a629d36bf518 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:30.509298 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b02b6fb1-945b-4ebe-8d85-a629d36bf518 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1723 microversion: 2.1 time: 0.153464 Aug 01 14:25:30.509892 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 287/586] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:30 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:30.728634 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4adaab11-08e6-4130-883b-880df172a3f2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:30.729222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-4adaab11-08e6-4130-883b-880df172a3f2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:30.736551 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4adaab11-08e6-4130-883b-880df172a3f2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:30.736997 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4adaab11-08e6-4130-883b-880df172a3f2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:30.737782 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4adaab11-08e6-4130-883b-880df172a3f2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:30.738225 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4adaab11-08e6-4130-883b-880df172a3f2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:30.872625 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4adaab11-08e6-4130-883b-880df172a3f2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:30.880527 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4adaab11-08e6-4130-883b-880df172a3f2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:30.882057 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4adaab11-08e6-4130-883b-880df172a3f2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:30.883240 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4adaab11-08e6-4130-883b-880df172a3f2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.158515 Aug 01 14:25:30.883796 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 300/587] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:30 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:31.531709 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7d3c880e-c549-40e3-8839-bcb639e4e9e2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:31.532248 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7d3c880e-c549-40e3-8839-bcb639e4e9e2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:31.538764 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7d3c880e-c549-40e3-8839-bcb639e4e9e2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:31.540970 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7d3c880e-c549-40e3-8839-bcb639e4e9e2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:31.540970 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7d3c880e-c549-40e3-8839-bcb639e4e9e2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:31.540970 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7d3c880e-c549-40e3-8839-bcb639e4e9e2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:31.671483 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7d3c880e-c549-40e3-8839-bcb639e4e9e2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:31.679497 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7d3c880e-c549-40e3-8839-bcb639e4e9e2 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1723 microversion: 2.1 time: 0.152306 Aug 01 14:25:31.680067 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 288/588] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:31 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:31.907271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a518806b-28d6-423f-aaf2-64c8e3d4327d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:31.907990 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a518806b-28d6-423f-aaf2-64c8e3d4327d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:31.914308 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a518806b-28d6-423f-aaf2-64c8e3d4327d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:31.915266 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a518806b-28d6-423f-aaf2-64c8e3d4327d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:31.915829 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a518806b-28d6-423f-aaf2-64c8e3d4327d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:31.916212 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a518806b-28d6-423f-aaf2-64c8e3d4327d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:32.048399 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a518806b-28d6-423f-aaf2-64c8e3d4327d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:32.056326 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a518806b-28d6-423f-aaf2-64c8e3d4327d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:32.057847 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a518806b-28d6-423f-aaf2-64c8e3d4327d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:32.059027 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a518806b-28d6-423f-aaf2-64c8e3d4327d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.155955 Aug 01 14:25:32.060222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 301/589] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:31 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:32.700858 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-759f9b40-1f06-4715-828a-9990a826f86d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:32.701458 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-759f9b40-1f06-4715-828a-9990a826f86d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:32.707867 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-759f9b40-1f06-4715-828a-9990a826f86d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:32.708318 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-759f9b40-1f06-4715-828a-9990a826f86d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:32.709068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-759f9b40-1f06-4715-828a-9990a826f86d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:32.709500 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-759f9b40-1f06-4715-828a-9990a826f86d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:32.835989 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-759f9b40-1f06-4715-828a-9990a826f86d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:32.844947 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-759f9b40-1f06-4715-828a-9990a826f86d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1729 microversion: 2.1 time: 0.148419 Aug 01 14:25:32.845518 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 289/590] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:32 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:32.865857 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-df8d228d-b88e-4135-8696-ab8c7e6f2de9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:32.866349 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-df8d228d-b88e-4135-8696-ab8c7e6f2de9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:32.872785 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-df8d228d-b88e-4135-8696-ab8c7e6f2de9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:32.873229 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-df8d228d-b88e-4135-8696-ab8c7e6f2de9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:32.874021 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-df8d228d-b88e-4135-8696-ab8c7e6f2de9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:32.874455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-df8d228d-b88e-4135-8696-ab8c7e6f2de9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:32.953198 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-df8d228d-b88e-4135-8696-ab8c7e6f2de9 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091267 Aug 01 14:25:32.953815 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 302/591] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Aug 1 14:25:32 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:33.082254 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-cc66c589-09b1-4237-9ed6-d9d381c3a540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:33.082896 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-cc66c589-09b1-4237-9ed6-d9d381c3a540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:33.089037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cc66c589-09b1-4237-9ed6-d9d381c3a540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:33.089481 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cc66c589-09b1-4237-9ed6-d9d381c3a540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:33.090268 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cc66c589-09b1-4237-9ed6-d9d381c3a540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:33.091237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cc66c589-09b1-4237-9ed6-d9d381c3a540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:33.234397 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-cc66c589-09b1-4237-9ed6-d9d381c3a540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:33.242938 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-cc66c589-09b1-4237-9ed6-d9d381c3a540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:33.244442 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-cc66c589-09b1-4237-9ed6-d9d381c3a540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:33.245603 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-cc66c589-09b1-4237-9ed6-d9d381c3a540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.167269 Aug 01 14:25:33.246209 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 290/592] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:33 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:25:33.885022 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-08c87262-9129-4983-8fa2-eb34a254a3db req-8269d233-1a58-4fec-8170-fdb918c25d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff34e0e-c728-4ffb-8eba-169ede959890", "tag": "1e5c663d-f700-413f-aae1-9880c79000d4"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:33.895785 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-08c87262-9129-4983-8fa2-eb34a254a3db req-8269d233-1a58-4fec-8170-fdb918c25d16 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:33.896835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-08c87262-9129-4983-8fa2-eb34a254a3db req-8269d233-1a58-4fec-8170-fdb918c25d16 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:33.911131 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-08c87262-9129-4983-8fa2-eb34a254a3db req-8269d233-1a58-4fec-8170-fdb918c25d16 service nova] Creating event network-changed:1e5c663d-f700-413f-aae1-9880c79000d4 for instance eff34e0e-c728-4ffb-8eba-169ede959890 on hv-cinder-78729 Aug 01 14:25:33.916327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-08c87262-9129-4983-8fa2-eb34a254a3db req-8269d233-1a58-4fec-8170-fdb918c25d16 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034771 Aug 01 14:25:33.917117 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 303/593] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:34.269098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7a98fc72-699a-4765-b499-3f102571ba3b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:34.269888 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7a98fc72-699a-4765-b499-3f102571ba3b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:34.276716 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7a98fc72-699a-4765-b499-3f102571ba3b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:34.277177 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7a98fc72-699a-4765-b499-3f102571ba3b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:34.278067 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7a98fc72-699a-4765-b499-3f102571ba3b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:34.278704 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7a98fc72-699a-4765-b499-3f102571ba3b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:34.406688 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7a98fc72-699a-4765-b499-3f102571ba3b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:34.414550 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7a98fc72-699a-4765-b499-3f102571ba3b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:34.416183 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7a98fc72-699a-4765-b499-3f102571ba3b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:34.417349 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7a98fc72-699a-4765-b499-3f102571ba3b tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.152164 Aug 01 14:25:34.417950 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 291/594] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:34 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:35.442004 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-72bac09e-fc47-46a4-b854-3915a0aa3f7a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:35.442667 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-72bac09e-fc47-46a4-b854-3915a0aa3f7a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:35.448886 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-72bac09e-fc47-46a4-b854-3915a0aa3f7a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:35.449341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-72bac09e-fc47-46a4-b854-3915a0aa3f7a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:35.450185 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-72bac09e-fc47-46a4-b854-3915a0aa3f7a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:35.450630 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-72bac09e-fc47-46a4-b854-3915a0aa3f7a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:35.589850 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-72bac09e-fc47-46a4-b854-3915a0aa3f7a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:35.598306 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-72bac09e-fc47-46a4-b854-3915a0aa3f7a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:35.599829 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-72bac09e-fc47-46a4-b854-3915a0aa3f7a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:35.601005 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-72bac09e-fc47-46a4-b854-3915a0aa3f7a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.163864 Aug 01 14:25:35.601561 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 304/595] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:35 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:36.081240 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-fe396be1-270e-4e83-8788-60242e0a2230 req-5a8c9818-176d-4302-8a89-02486f9b9ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff34e0e-c728-4ffb-8eba-169ede959890", "tag": "1e5c663d-f700-413f-aae1-9880c79000d4"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:36.092072 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-fe396be1-270e-4e83-8788-60242e0a2230 req-5a8c9818-176d-4302-8a89-02486f9b9ee8 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:36.092867 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-fe396be1-270e-4e83-8788-60242e0a2230 req-5a8c9818-176d-4302-8a89-02486f9b9ee8 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:36.104389 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-fe396be1-270e-4e83-8788-60242e0a2230 req-5a8c9818-176d-4302-8a89-02486f9b9ee8 service nova] Creating event network-changed:1e5c663d-f700-413f-aae1-9880c79000d4 for instance eff34e0e-c728-4ffb-8eba-169ede959890 on hv-cinder-78729 Aug 01 14:25:36.110312 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-fe396be1-270e-4e83-8788-60242e0a2230 req-5a8c9818-176d-4302-8a89-02486f9b9ee8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032728 Aug 01 14:25:36.110953 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 292/596] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:36.625118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-da6023fc-2790-4850-8b73-fad4e7fe1095 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:36.625727 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-da6023fc-2790-4850-8b73-fad4e7fe1095 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:36.632386 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-da6023fc-2790-4850-8b73-fad4e7fe1095 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:36.632833 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-da6023fc-2790-4850-8b73-fad4e7fe1095 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:36.633615 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-da6023fc-2790-4850-8b73-fad4e7fe1095 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:36.634083 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-da6023fc-2790-4850-8b73-fad4e7fe1095 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:36.776164 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-da6023fc-2790-4850-8b73-fad4e7fe1095 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:36.785878 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-da6023fc-2790-4850-8b73-fad4e7fe1095 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:36.787520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-da6023fc-2790-4850-8b73-fad4e7fe1095 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:36.788824 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-da6023fc-2790-4850-8b73-fad4e7fe1095 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1724 microversion: 2.20 time: 0.167672 Aug 01 14:25:36.789465 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 305/597] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:36 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:25:37.814378 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f2b6417d-7c48-4f8a-9953-1c5aa776a581 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:37.815083 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f2b6417d-7c48-4f8a-9953-1c5aa776a581 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:37.823994 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2b6417d-7c48-4f8a-9953-1c5aa776a581 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:37.825525 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2b6417d-7c48-4f8a-9953-1c5aa776a581 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:37.826567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2b6417d-7c48-4f8a-9953-1c5aa776a581 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:37.827012 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2b6417d-7c48-4f8a-9953-1c5aa776a581 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:37.896763 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f2b6417d-7c48-4f8a-9953-1c5aa776a581 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:37.909254 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f2b6417d-7c48-4f8a-9953-1c5aa776a581 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:37.910927 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f2b6417d-7c48-4f8a-9953-1c5aa776a581 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:37.912281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f2b6417d-7c48-4f8a-9953-1c5aa776a581 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 200 len: 1367 microversion: 2.20 time: 0.103711 Aug 01 14:25:37.913564 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 293/598] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:37 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 1367 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:38.130772 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-ff36da6d-b47f-47b7-ae41-9ab836e131a4 req-f8037a30-fc1e-4a3f-b3fe-3bfa7a694b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c41c564-40f2-47cf-820b-915c3d43ccb3", "name": "network-vif-deleted", "tag": "bc816aff-9768-4c40-a6d1-adb40e9ce6a1"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:38.142752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-ff36da6d-b47f-47b7-ae41-9ab836e131a4 req-f8037a30-fc1e-4a3f-b3fe-3bfa7a694b14 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:38.143283 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-ff36da6d-b47f-47b7-ae41-9ab836e131a4 req-f8037a30-fc1e-4a3f-b3fe-3bfa7a694b14 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:38.156114 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-ff36da6d-b47f-47b7-ae41-9ab836e131a4 req-f8037a30-fc1e-4a3f-b3fe-3bfa7a694b14 service nova] Creating event network-vif-deleted:bc816aff-9768-4c40-a6d1-adb40e9ce6a1 for instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 on hv-cinder-78729 Aug 01 14:25:38.161922 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-ff36da6d-b47f-47b7-ae41-9ab836e131a4 req-f8037a30-fc1e-4a3f-b3fe-3bfa7a694b14 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034735 Aug 01 14:25:38.163326 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 306/599] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:38.938572 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-01b88d80-b1e3-4b65-a5ed-86bc0e101960 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:38.940185 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-01b88d80-b1e3-4b65-a5ed-86bc0e101960 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:38.946661 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-01b88d80-b1e3-4b65-a5ed-86bc0e101960 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:38.947114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-01b88d80-b1e3-4b65-a5ed-86bc0e101960 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:38.947899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-01b88d80-b1e3-4b65-a5ed-86bc0e101960 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:38.948660 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-01b88d80-b1e3-4b65-a5ed-86bc0e101960 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:38.963093 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-01b88d80-b1e3-4b65-a5ed-86bc0e101960 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] HTTP exception thrown: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-01b88d80-b1e3-4b65-a5ed-86bc0e101960 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Request method failure captured: Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 HTTP/1.1 Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-E4Kh_4Q5v4twlhojHMUYyrJe3rqBsyfE1im5S436Ixk8uQiMnLQ85UmraKwEIZ9zvhH0k5WtqYMmDVrU6__WpArXoYhaWHeSQ-xVJi-tyokMLo2sb-QZmjdT9iWAh7CqL7-RO-6_Vp9FlRWdUEosQOtmmho_h9Pw9pjgd8vXm4Xxo Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: 6bcd2b3241464b25a20c9d559ed9a049 Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:25:38.965049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:25:38.967471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:25:38.967471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:25:38.967471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: 6bcd2b3241464b25a20c9d559ed9a049 Aug 01 14:25:38.967471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:25:38.967471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-AttachVolumeShelveTestJSON-1335025751-project Aug 01 14:25:38.967471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:25:38.967471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:25:38.967471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: 14c4c1027d8a42c081d69fa821216675 Aug 01 14:25:38.967471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1335025751-project Aug 01 14:25:38.967471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:25:38.967471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. Aug 01 14:25:38.967471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': '9c41c564-40f2-47cf-820b-915c3d43ccb3'} Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:25:38.968402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. Aug 01 14:25:38.970270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:25:38.971532 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-01b88d80-b1e3-4b65-a5ed-86bc0e101960 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Returning 404 to user: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:25:38.971532 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-01b88d80-b1e3-4b65-a5ed-86bc0e101960 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 404 len: 111 microversion: 2.20 time: 0.034279 Aug 01 14:25:38.971532 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 294/600] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:38 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:25:38.977517 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3f256d8c-7ada-46d0-b70d-e57f3952f9e9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '.version_select at 0x7fb2540623a0>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:39.103082 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3f256d8c-7ada-46d0-b70d-e57f3952f9e9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107727446" status: 204 len: 0 microversion: 2.20 time: 0.129780 Aug 01 14:25:39.103665 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 307/601] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Aug 1 14:25:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107727446 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 14:25:40.039595 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-27681dba-3051-4810-911f-1594984e35b9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Action: 'create', calling method: .version_select at 0x7fb2540939d0>, body: {"keypair": {"name": "tempest-keypair-1743085022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF35cne9euiMLrE9S5jZpT3zQBNLWjY6qzX+j7OJmJl8cTgayT0SEhhAlWprZYSFxXsBv+qGFQStoIsfTLJzPDVmZs0Whi1hgT7jg7zcytUcs4Ws79C73yEcKOGfZBVw0A=="}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:40.055955 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-27681dba-3051-4810-911f-1594984e35b9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Getting quotas for project 6bcd2b3241464b25a20c9d559ed9a049. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:25:40.059758 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-27681dba-3051-4810-911f-1594984e35b9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Getting quotas for user 14c4c1027d8a42c081d69fa821216675 and project 6bcd2b3241464b25a20c9d559ed9a049. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:25:40.148120 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-27681dba-3051-4810-911f-1594984e35b9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.112525 Aug 01 14:25:40.148708 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 295/602] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Aug 1 14:25:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 14:25:42.508859 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1d1dc83b-bc25-4c64-ba5f-710ca7eecb89 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-199990809", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cbff8890-c84b-430f-a29c-0bb50c33b50e"}], "security_groups": [{"name": "tempest-securitygroup--1700131101"}], "key_name": "tempest-keypair-1743085022", "user_data": "}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:42.518801 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:42.619730 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.network.neutron [None req-1d1dc83b-bc25-4c64-ba5f-710ca7eecb89 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] validate_networks() for [('cbff8890-c84b-430f-a29c-0bb50c33b50e', None, None, None, None, None)] {{(pid=118247) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:25:43.060376 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-1d1dc83b-bc25-4c64-ba5f-710ca7eecb89 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Flavor limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:25:43.060886 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-1d1dc83b-bc25-4c64-ba5f-710ca7eecb89 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Image limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:25:43.061363 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-1d1dc83b-bc25-4c64-ba5f-710ca7eecb89 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Flavor pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:25:43.061803 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-1d1dc83b-bc25-4c64-ba5f-710ca7eecb89 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Image pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:25:43.062225 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-1d1dc83b-bc25-4c64-ba5f-710ca7eecb89 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:25:43.071007 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1d1dc83b-bc25-4c64-ba5f-710ca7eecb89 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:43.071618 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1d1dc83b-bc25-4c64-ba5f-710ca7eecb89 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:43.072424 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1d1dc83b-bc25-4c64-ba5f-710ca7eecb89 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:43.072870 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1d1dc83b-bc25-4c64-ba5f-710ca7eecb89 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:43.089393 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-1d1dc83b-bc25-4c64-ba5f-710ca7eecb89 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Getting quotas for project 6bcd2b3241464b25a20c9d559ed9a049. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:25:43.093479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-1d1dc83b-bc25-4c64-ba5f-710ca7eecb89 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Getting quotas for user 14c4c1027d8a42c081d69fa821216675 and project 6bcd2b3241464b25a20c9d559ed9a049. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:25:43.104286 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1d1dc83b-bc25-4c64-ba5f-710ca7eecb89 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Going to run 1 instances... {{(pid=118247) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:25:43.107172 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1d1dc83b-bc25-4c64-ba5f-710ca7eecb89 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118247) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:25:43.241986 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1d1dc83b-bc25-4c64-ba5f-710ca7eecb89 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.737216 Aug 01 14:25:43.242638 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 308/603] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Aug 1 14:25:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 14:25:43.255210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e8542e2b-af2f-46f9-beb3-eead92cd6cc5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:43.255916 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e8542e2b-af2f-46f9-beb3-eead92cd6cc5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:43.258606 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:43.313520 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e8542e2b-af2f-46f9-beb3-eead92cd6cc5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:43.317763 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e8542e2b-af2f-46f9-beb3-eead92cd6cc5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:43.319299 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e8542e2b-af2f-46f9-beb3-eead92cd6cc5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:43.320412 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e8542e2b-af2f-46f9-beb3-eead92cd6cc5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1281 microversion: 2.20 time: 0.070117 Aug 01 14:25:43.320960 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 296/604] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:43 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:25:44.219958 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f9ffa3d9-d44f-4d66-9cd5-44d42f5b9fa6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:44.222324 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f9ffa3d9-d44f-4d66-9cd5-44d42f5b9fa6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:44.228696 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f9ffa3d9-d44f-4d66-9cd5-44d42f5b9fa6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:44.229151 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f9ffa3d9-d44f-4d66-9cd5-44d42f5b9fa6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:44.230019 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f9ffa3d9-d44f-4d66-9cd5-44d42f5b9fa6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:44.230456 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f9ffa3d9-d44f-4d66-9cd5-44d42f5b9fa6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:44.260608 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f9ffa3d9-d44f-4d66-9cd5-44d42f5b9fa6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045892 Aug 01 14:25:44.261159 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 309/605] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:25:44 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:25:44.336952 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5d572356-ea26-4d06-ba3b-e634679052d5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:44.337528 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5d572356-ea26-4d06-ba3b-e634679052d5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:44.343679 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b52d93ec-2c5d-4b28-b03c-677651f07866 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:44.344292 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b52d93ec-2c5d-4b28-b03c-677651f07866 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:44.344914 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5d572356-ea26-4d06-ba3b-e634679052d5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:44.345443 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5d572356-ea26-4d06-ba3b-e634679052d5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:44.346237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5d572356-ea26-4d06-ba3b-e634679052d5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:44.346672 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5d572356-ea26-4d06-ba3b-e634679052d5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:44.350316 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b52d93ec-2c5d-4b28-b03c-677651f07866 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:44.350771 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b52d93ec-2c5d-4b28-b03c-677651f07866 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:44.351546 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b52d93ec-2c5d-4b28-b03c-677651f07866 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:44.351988 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b52d93ec-2c5d-4b28-b03c-677651f07866 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:44.373862 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5d572356-ea26-4d06-ba3b-e634679052d5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Going to try to terminate instance {{(pid=118246) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:25:44.417128 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b52d93ec-2c5d-4b28-b03c-677651f07866 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:44.425913 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b52d93ec-2c5d-4b28-b03c-677651f07866 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:44.427505 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b52d93ec-2c5d-4b28-b03c-677651f07866 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:44.428546 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b52d93ec-2c5d-4b28-b03c-677651f07866 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1285 microversion: 2.20 time: 0.089315 Aug 01 14:25:44.429108 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 310/606] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:44 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:25:44.689172 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5d572356-ea26-4d06-ba3b-e634679052d5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 204 len: 0 microversion: 2.1 time: 0.355963 Aug 01 14:25:44.689705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 297/607] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:25:44 2022] DELETE /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:25:44.698133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4e992332-314d-4968-b657-59b73e79f3db tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:44.698747 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-4e992332-314d-4968-b657-59b73e79f3db tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:44.704920 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4e992332-314d-4968-b657-59b73e79f3db tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:44.705369 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4e992332-314d-4968-b657-59b73e79f3db tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:44.706175 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4e992332-314d-4968-b657-59b73e79f3db tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:44.706615 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4e992332-314d-4968-b657-59b73e79f3db tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:44.838406 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4e992332-314d-4968-b657-59b73e79f3db tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:44.846281 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4e992332-314d-4968-b657-59b73e79f3db tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1673 microversion: 2.1 time: 0.152113 Aug 01 14:25:44.846846 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 311/608] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:44 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:45.452750 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d1b09159-ef58-4b31-85f3-8808ab60d4b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:45.453451 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d1b09159-ef58-4b31-85f3-8808ab60d4b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:45.460055 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d1b09159-ef58-4b31-85f3-8808ab60d4b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:45.460510 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d1b09159-ef58-4b31-85f3-8808ab60d4b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:45.461269 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d1b09159-ef58-4b31-85f3-8808ab60d4b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:45.461732 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d1b09159-ef58-4b31-85f3-8808ab60d4b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:45.523020 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d1b09159-ef58-4b31-85f3-8808ab60d4b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:45.532844 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d1b09159-ef58-4b31-85f3-8808ab60d4b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:45.533436 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d1b09159-ef58-4b31-85f3-8808ab60d4b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:45.534612 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d1b09159-ef58-4b31-85f3-8808ab60d4b5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1333 microversion: 2.20 time: 0.086107 Aug 01 14:25:45.535119 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 298/609] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:45 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:45.867970 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-56a21363-cda8-47c8-97d3-ea7bf69798c5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:45.868613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-56a21363-cda8-47c8-97d3-ea7bf69798c5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:45.876091 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-56a21363-cda8-47c8-97d3-ea7bf69798c5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:45.876544 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-56a21363-cda8-47c8-97d3-ea7bf69798c5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:45.877309 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-56a21363-cda8-47c8-97d3-ea7bf69798c5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:45.877801 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-56a21363-cda8-47c8-97d3-ea7bf69798c5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:46.011314 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-56a21363-cda8-47c8-97d3-ea7bf69798c5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:46.018839 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-56a21363-cda8-47c8-97d3-ea7bf69798c5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1673 microversion: 2.1 time: 0.154981 Aug 01 14:25:46.019409 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 312/610] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:45 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:46.557527 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f2f13783-c793-41bf-b859-bab479f3a59d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:46.558210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f2f13783-c793-41bf-b859-bab479f3a59d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:46.564992 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2f13783-c793-41bf-b859-bab479f3a59d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:46.565446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2f13783-c793-41bf-b859-bab479f3a59d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:46.566239 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2f13783-c793-41bf-b859-bab479f3a59d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:46.566685 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2f13783-c793-41bf-b859-bab479f3a59d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:46.631464 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f2f13783-c793-41bf-b859-bab479f3a59d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:46.640026 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f2f13783-c793-41bf-b859-bab479f3a59d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:46.641552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f2f13783-c793-41bf-b859-bab479f3a59d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:46.642695 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f2f13783-c793-41bf-b859-bab479f3a59d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1333 microversion: 2.20 time: 0.089100 Aug 01 14:25:46.643283 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 299/611] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:46 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:47.040826 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-861b68cc-c875-49cf-9794-4647e40bac46 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:47.041564 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-861b68cc-c875-49cf-9794-4647e40bac46 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:47.048763 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-861b68cc-c875-49cf-9794-4647e40bac46 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:47.049218 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-861b68cc-c875-49cf-9794-4647e40bac46 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:47.050021 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-861b68cc-c875-49cf-9794-4647e40bac46 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:47.050467 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-861b68cc-c875-49cf-9794-4647e40bac46 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:47.612745 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-861b68cc-c875-49cf-9794-4647e40bac46 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:47.627063 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-861b68cc-c875-49cf-9794-4647e40bac46 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1673 microversion: 2.1 time: 0.590085 Aug 01 14:25:47.627679 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 313/612] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:47 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1673 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:47.668091 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ad1797b3-d290-4555-9851-724a43652376 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:47.668885 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ad1797b3-d290-4555-9851-724a43652376 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:47.680341 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ad1797b3-d290-4555-9851-724a43652376 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:47.681133 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ad1797b3-d290-4555-9851-724a43652376 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:47.682513 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ad1797b3-d290-4555-9851-724a43652376 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:47.683054 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ad1797b3-d290-4555-9851-724a43652376 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:47.778645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ad1797b3-d290-4555-9851-724a43652376 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:47.784570 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:47.792066 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ad1797b3-d290-4555-9851-724a43652376 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:47.793640 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ad1797b3-d290-4555-9851-724a43652376 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:47.794822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ad1797b3-d290-4555-9851-724a43652376 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1341 microversion: 2.20 time: 0.132800 Aug 01 14:25:47.795827 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 300/613] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:47 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1341 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:48.641868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-6bae04e2-88f1-48f6-9611-3fc4c91ef7f2 req-478f7745-4e8d-4f0d-acbf-cff219bf824b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb5f425-d747-41d4-bed5-211a5d80e32b", "name": "network-vif-deleted", "tag": "5314437c-b6c2-401f-b4c2-178a92e38017"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:48.648455 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c7483abf-b466-4503-8066-19eae1557d7f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:48.649077 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c7483abf-b466-4503-8066-19eae1557d7f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:48.656235 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c7483abf-b466-4503-8066-19eae1557d7f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:48.656700 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c7483abf-b466-4503-8066-19eae1557d7f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:48.657503 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c7483abf-b466-4503-8066-19eae1557d7f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:48.657965 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c7483abf-b466-4503-8066-19eae1557d7f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:48.661930 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-6bae04e2-88f1-48f6-9611-3fc4c91ef7f2 req-478f7745-4e8d-4f0d-acbf-cff219bf824b service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:48.662561 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-6bae04e2-88f1-48f6-9611-3fc4c91ef7f2 req-478f7745-4e8d-4f0d-acbf-cff219bf824b service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:48.685012 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-6bae04e2-88f1-48f6-9611-3fc4c91ef7f2 req-478f7745-4e8d-4f0d-acbf-cff219bf824b service nova] Creating event network-vif-deleted:5314437c-b6c2-401f-b4c2-178a92e38017 for instance 2eb5f425-d747-41d4-bed5-211a5d80e32b on hv-cinder-78729 Aug 01 14:25:48.697248 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-6bae04e2-88f1-48f6-9611-3fc4c91ef7f2 req-478f7745-4e8d-4f0d-acbf-cff219bf824b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047039 Aug 01 14:25:48.698287 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 314/614] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:48.735882 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c7483abf-b466-4503-8066-19eae1557d7f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:48.744993 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c7483abf-b466-4503-8066-19eae1557d7f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1606 microversion: 2.1 time: 0.100219 Aug 01 14:25:48.758286 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 301/615] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:48 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1606 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:48.820003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ea97d2f4-4afe-4a2e-8daa-29777a258e19 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:48.821083 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ea97d2f4-4afe-4a2e-8daa-29777a258e19 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:48.834234 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ea97d2f4-4afe-4a2e-8daa-29777a258e19 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:48.834234 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ea97d2f4-4afe-4a2e-8daa-29777a258e19 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:48.834234 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ea97d2f4-4afe-4a2e-8daa-29777a258e19 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:48.834234 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ea97d2f4-4afe-4a2e-8daa-29777a258e19 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:49.023892 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ea97d2f4-4afe-4a2e-8daa-29777a258e19 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:49.034943 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ea97d2f4-4afe-4a2e-8daa-29777a258e19 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:49.036974 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ea97d2f4-4afe-4a2e-8daa-29777a258e19 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:49.038385 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ea97d2f4-4afe-4a2e-8daa-29777a258e19 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1407 microversion: 2.20 time: 0.223302 Aug 01 14:25:49.039185 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 315/616] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:48 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:49.771160 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-a1330ac5-1583-4cc5-95cd-09c488dd82b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:49.772360 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-a1330ac5-1583-4cc5-95cd-09c488dd82b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:49.788143 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a1330ac5-1583-4cc5-95cd-09c488dd82b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:49.788821 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a1330ac5-1583-4cc5-95cd-09c488dd82b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:49.790799 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a1330ac5-1583-4cc5-95cd-09c488dd82b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:49.792746 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a1330ac5-1583-4cc5-95cd-09c488dd82b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:49.819951 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:25:49.821613 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Mon Aug 1 14:25:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b (ip 10.222.0.49) !!! Aug 01 14:25:49.844357 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a1330ac5-1583-4cc5-95cd-09c488dd82b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:49.845745 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a1330ac5-1583-4cc5-95cd-09c488dd82b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:49.846228 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-a1330ac5-1583-4cc5-95cd-09c488dd82b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lazy-loading 'fault' on Instance uuid 2eb5f425-d747-41d4-bed5-211a5d80e32b {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:25:49.892712 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a1330ac5-1583-4cc5-95cd-09c488dd82b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:49.900830 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-a1330ac5-1583-4cc5-95cd-09c488dd82b6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 200 len: 1327 microversion: 2.1 time: 0.136389 Aug 01 14:25:49.901422 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 302/617] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:49 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 1327 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:50.071462 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d089daca-54da-4e1f-992a-87892ea737bc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:50.071990 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d089daca-54da-4e1f-992a-87892ea737bc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:50.079164 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d089daca-54da-4e1f-992a-87892ea737bc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:50.079615 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d089daca-54da-4e1f-992a-87892ea737bc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:50.080384 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d089daca-54da-4e1f-992a-87892ea737bc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:50.080819 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d089daca-54da-4e1f-992a-87892ea737bc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:50.099919 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=100 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:50.214830 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d089daca-54da-4e1f-992a-87892ea737bc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:50.223531 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d089daca-54da-4e1f-992a-87892ea737bc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:50.225043 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d089daca-54da-4e1f-992a-87892ea737bc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:50.226185 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d089daca-54da-4e1f-992a-87892ea737bc tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1407 microversion: 2.20 time: 0.158644 Aug 01 14:25:50.227100 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 316/618] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:50 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:50.712373 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-91a31233-e789-4c81-8f92-296822d49127 req-90310709-005c-4ac8-a2b5-80a784cdfdae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "015b4877-f47b-4e45-a2b8-e36ba4bacf82", "tag": "09014052-8b79-46d5-99ce-d8c6b6ccd445"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:50.722796 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-91a31233-e789-4c81-8f92-296822d49127 req-90310709-005c-4ac8-a2b5-80a784cdfdae service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:50.723252 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-91a31233-e789-4c81-8f92-296822d49127 req-90310709-005c-4ac8-a2b5-80a784cdfdae service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:50.735076 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-91a31233-e789-4c81-8f92-296822d49127 req-90310709-005c-4ac8-a2b5-80a784cdfdae service nova] Creating event network-changed:09014052-8b79-46d5-99ce-d8c6b6ccd445 for instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 on hv-cinder-78729 Aug 01 14:25:50.740704 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-91a31233-e789-4c81-8f92-296822d49127 req-90310709-005c-4ac8-a2b5-80a784cdfdae service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032354 Aug 01 14:25:50.741300 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 303/619] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:50.924859 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-14e79a26-707d-46c1-a4ec-73c189fb9d30 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:50.925461 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-14e79a26-707d-46c1-a4ec-73c189fb9d30 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:50.931578 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-14e79a26-707d-46c1-a4ec-73c189fb9d30 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:50.932024 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-14e79a26-707d-46c1-a4ec-73c189fb9d30 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:50.932802 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-14e79a26-707d-46c1-a4ec-73c189fb9d30 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:50.933254 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-14e79a26-707d-46c1-a4ec-73c189fb9d30 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:50.946879 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-14e79a26-707d-46c1-a4ec-73c189fb9d30 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] HTTP exception thrown: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-14e79a26-707d-46c1-a4ec-73c189fb9d30 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Request method failure captured: Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b HTTP/1.1 Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-E5gDnLDrW6jn471VQH6hRhWTkgL7UmqMzqse6VaAIspmL-Ep7LFUyMz4cB_jTfmGhl_A4SC4KvftD9rSHBjjlz0uvS3Q5_6SAeNe5cAmREpguhoLj1hhIs9NmEM_J9PJzDJR8JmMOcx0zWYTZSi92szh8aXrQm6XPEuV2iWtyO_N8 Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: 3f7ea2daaa864df7973b21d1d13ae47a Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:25:50.948623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:25:50.950261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:25:50.950261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:25:50.950261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: 3f7ea2daaa864df7973b21d1d13ae47a Aug 01 14:25:50.950261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:25:50.950261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-AttachVolumeTestJSON-218155940-project Aug 01 14:25:50.950261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:25:50.950261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:25:50.950261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: 47da4644803547869a303a039ee7a28c Aug 01 14:25:50.950261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-AttachVolumeTestJSON-218155940-project Aug 01 14:25:50.950261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:25:50.950261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. Aug 01 14:25:50.950261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '2eb5f425-d747-41d4-bed5-211a5d80e32b'} Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:25:50.958480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. Aug 01 14:25:50.960076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:25:50.961442 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-14e79a26-707d-46c1-a4ec-73c189fb9d30 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Returning 404 to user: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:25:50.961442 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-14e79a26-707d-46c1-a4ec-73c189fb9d30 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 404 len: 111 microversion: 2.1 time: 0.030333 Aug 01 14:25:50.961442 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 317/620] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:50 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:25:50.961690 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1e26553f-fe14-4e34-89ca-e0cc84c3ce9d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '.version_select at 0x7fb24efbd820>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:51.033272 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-1e26553f-fe14-4e34-89ca-e0cc84c3ce9d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-568684628" status: 202 len: 0 microversion: 2.1 time: 0.077294 Aug 01 14:25:51.033905 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 304/621] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Aug 1 14:25:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-568684628 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:25:51.249247 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4ba1b4c2-6782-45e9-afea-7d503b478f32 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:51.250530 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-4ba1b4c2-6782-45e9-afea-7d503b478f32 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:51.257589 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4ba1b4c2-6782-45e9-afea-7d503b478f32 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:51.258065 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4ba1b4c2-6782-45e9-afea-7d503b478f32 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:51.258825 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4ba1b4c2-6782-45e9-afea-7d503b478f32 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:51.259164 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4ba1b4c2-6782-45e9-afea-7d503b478f32 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:51.508985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4ba1b4c2-6782-45e9-afea-7d503b478f32 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:51.519567 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4ba1b4c2-6782-45e9-afea-7d503b478f32 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:51.521013 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4ba1b4c2-6782-45e9-afea-7d503b478f32 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:51.522349 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4ba1b4c2-6782-45e9-afea-7d503b478f32 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1407 microversion: 2.20 time: 0.277732 Aug 01 14:25:51.522982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 318/622] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:51 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:51.917545 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-11353bda-0c91-48e6-a51b-7886647d940e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Action: 'create', calling method: .version_select at 0x7fb24efb5550>, body: {"keypair": {"name": "tempest-keypair-855277406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgHe68EJTrlt8h61X0ihSR8Z5K8mINnPfqfryVL6mZdqnt7jNR2r0cnRsBj4TwJSB2f0Ee/NQlpFQoGLPOY8uVlu33oqgkd2YW6wW6HEYuw36/q/wsyhGAGdnw45Ea2MQ=="}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:51.936449 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-11353bda-0c91-48e6-a51b-7886647d940e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Getting quotas for project 3f7ea2daaa864df7973b21d1d13ae47a. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:25:51.940506 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-11353bda-0c91-48e6-a51b-7886647d940e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Getting quotas for user 47da4644803547869a303a039ee7a28c and project 3f7ea2daaa864df7973b21d1d13ae47a. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:25:52.057430 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-11353bda-0c91-48e6-a51b-7886647d940e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.144421 Aug 01 14:25:52.064357 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 305/623] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Aug 1 14:25:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:25:52.548657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-95c5280f-21fb-4c42-b0be-926c2d024ef0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:52.549256 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-95c5280f-21fb-4c42-b0be-926c2d024ef0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:52.560266 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-95c5280f-21fb-4c42-b0be-926c2d024ef0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:52.560784 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-95c5280f-21fb-4c42-b0be-926c2d024ef0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:52.561979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-95c5280f-21fb-4c42-b0be-926c2d024ef0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:52.562462 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-95c5280f-21fb-4c42-b0be-926c2d024ef0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:52.747173 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-95c5280f-21fb-4c42-b0be-926c2d024ef0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:52.756013 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-95c5280f-21fb-4c42-b0be-926c2d024ef0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:52.757488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-95c5280f-21fb-4c42-b0be-926c2d024ef0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:52.758738 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-95c5280f-21fb-4c42-b0be-926c2d024ef0 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1407 microversion: 2.20 time: 0.217413 Aug 01 14:25:52.759758 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 319/624] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:52 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:53.783163 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-02f95efc-874d-4f36-866d-daada170deb4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:53.785522 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-02f95efc-874d-4f36-866d-daada170deb4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:53.798807 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-02f95efc-874d-4f36-866d-daada170deb4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:53.798807 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-02f95efc-874d-4f36-866d-daada170deb4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:53.798807 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-02f95efc-874d-4f36-866d-daada170deb4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:53.798807 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-02f95efc-874d-4f36-866d-daada170deb4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:54.041176 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-02f95efc-874d-4f36-866d-daada170deb4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:54.050619 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-02f95efc-874d-4f36-866d-daada170deb4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:54.052514 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-02f95efc-874d-4f36-866d-daada170deb4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:54.053625 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-02f95efc-874d-4f36-866d-daada170deb4 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1407 microversion: 2.20 time: 0.275555 Aug 01 14:25:54.054321 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 306/625] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:53 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:54.938664 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1a6d456d-1c6a-4c07-8278-ed2dce1904e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1604961241", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0fea80f7-2a2a-46a4-990b-9057ef4495f4"}], "security_groups": [{"name": "tempest-securitygroup--709560839"}], "key_name": "tempest-keypair-855277406", "user_data": "}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:54.947990 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=2 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:54.948734 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=6 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:55.078173 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e1cba31e-2fb4-4489-9f41-73746e53e002 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:55.078920 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e1cba31e-2fb4-4489-9f41-73746e53e002 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:55.090836 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e1cba31e-2fb4-4489-9f41-73746e53e002 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:55.091297 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e1cba31e-2fb4-4489-9f41-73746e53e002 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:55.092700 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e1cba31e-2fb4-4489-9f41-73746e53e002 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:55.094652 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e1cba31e-2fb4-4489-9f41-73746e53e002 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:55.108252 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.network.neutron [None req-1a6d456d-1c6a-4c07-8278-ed2dce1904e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] validate_networks() for [('0fea80f7-2a2a-46a4-990b-9057ef4495f4', None, None, None, None, None)] {{(pid=118247) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:25:55.379559 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e1cba31e-2fb4-4489-9f41-73746e53e002 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:55.390607 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e1cba31e-2fb4-4489-9f41-73746e53e002 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:55.392256 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e1cba31e-2fb4-4489-9f41-73746e53e002 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:55.393454 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e1cba31e-2fb4-4489-9f41-73746e53e002 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1407 microversion: 2.20 time: 0.320854 Aug 01 14:25:55.394151 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 307/626] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:55 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:56.088511 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-1a6d456d-1c6a-4c07-8278-ed2dce1904e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Flavor limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:25:56.089550 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-1a6d456d-1c6a-4c07-8278-ed2dce1904e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Image limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:25:56.090454 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-1a6d456d-1c6a-4c07-8278-ed2dce1904e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Flavor pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:25:56.090962 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-1a6d456d-1c6a-4c07-8278-ed2dce1904e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Image pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:25:56.091544 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-1a6d456d-1c6a-4c07-8278-ed2dce1904e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:25:56.102454 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1a6d456d-1c6a-4c07-8278-ed2dce1904e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:56.103058 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1a6d456d-1c6a-4c07-8278-ed2dce1904e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:56.103984 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1a6d456d-1c6a-4c07-8278-ed2dce1904e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:56.107675 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1a6d456d-1c6a-4c07-8278-ed2dce1904e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:56.131034 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-1a6d456d-1c6a-4c07-8278-ed2dce1904e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Getting quotas for project 3f7ea2daaa864df7973b21d1d13ae47a. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:25:56.137340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-1a6d456d-1c6a-4c07-8278-ed2dce1904e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Getting quotas for user 47da4644803547869a303a039ee7a28c and project 3f7ea2daaa864df7973b21d1d13ae47a. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:25:56.159057 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1a6d456d-1c6a-4c07-8278-ed2dce1904e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Going to run 1 instances... {{(pid=118247) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:25:56.160000 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1a6d456d-1c6a-4c07-8278-ed2dce1904e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118247) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:25:56.250513 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-82f5e319-9648-4fb0-b8bd-4105c9c2bed0 req-0155a17d-0aef-4c6c-a7de-e7d6633f1ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015b4877-f47b-4e45-a2b8-e36ba4bacf82", "name": "network-vif-plugged", "status": "completed", "tag": "09014052-8b79-46d5-99ce-d8c6b6ccd445"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:25:56.265375 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-82f5e319-9648-4fb0-b8bd-4105c9c2bed0 req-0155a17d-0aef-4c6c-a7de-e7d6633f1ecb service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:56.265846 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-82f5e319-9648-4fb0-b8bd-4105c9c2bed0 req-0155a17d-0aef-4c6c-a7de-e7d6633f1ecb service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:56.282657 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-82f5e319-9648-4fb0-b8bd-4105c9c2bed0 req-0155a17d-0aef-4c6c-a7de-e7d6633f1ecb service nova] Creating event network-vif-plugged:09014052-8b79-46d5-99ce-d8c6b6ccd445 for instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 on hv-cinder-78729 Aug 01 14:25:56.287616 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-82f5e319-9648-4fb0-b8bd-4105c9c2bed0 req-0155a17d-0aef-4c6c-a7de-e7d6633f1ecb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044305 Aug 01 14:25:56.288217 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 308/627] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:25:56.310005 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1a6d456d-1c6a-4c07-8278-ed2dce1904e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.377285 Aug 01 14:25:56.322070 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 320/628] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:25:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 1390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:25:56.328306 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1b9830c4-42a7-4709-9c32-869e736e7a5f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:56.329627 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-1b9830c4-42a7-4709-9c32-869e736e7a5f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:56.418658 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b036f2bf-4881-4e6c-a823-caacebf0c148 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:56.419798 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b036f2bf-4881-4e6c-a823-caacebf0c148 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:56.437590 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b036f2bf-4881-4e6c-a823-caacebf0c148 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:56.437590 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b036f2bf-4881-4e6c-a823-caacebf0c148 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:56.437590 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b036f2bf-4881-4e6c-a823-caacebf0c148 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:56.437590 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b036f2bf-4881-4e6c-a823-caacebf0c148 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:56.469068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-1b9830c4-42a7-4709-9c32-869e736e7a5f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:56.483875 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-1b9830c4-42a7-4709-9c32-869e736e7a5f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1237 microversion: 2.1 time: 0.160741 Aug 01 14:25:56.491707 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 309/629] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:56 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1237 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:25:56.685097 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b036f2bf-4881-4e6c-a823-caacebf0c148 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:56.710134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b036f2bf-4881-4e6c-a823-caacebf0c148 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:56.711685 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b036f2bf-4881-4e6c-a823-caacebf0c148 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:56.712849 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b036f2bf-4881-4e6c-a823-caacebf0c148 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1407 microversion: 2.20 time: 0.300348 Aug 01 14:25:56.721471 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 321/630] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:56 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:25:57.507906 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0d7d465b-d66e-4048-acfe-60db87496685 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:57.508528 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0d7d465b-d66e-4048-acfe-60db87496685 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:57.517853 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0d7d465b-d66e-4048-acfe-60db87496685 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:57.518391 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0d7d465b-d66e-4048-acfe-60db87496685 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:57.519346 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0d7d465b-d66e-4048-acfe-60db87496685 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:57.519852 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0d7d465b-d66e-4048-acfe-60db87496685 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:57.585897 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-0d7d465b-d66e-4048-acfe-60db87496685 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:57.594174 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0d7d465b-d66e-4048-acfe-60db87496685 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1241 microversion: 2.1 time: 0.090079 Aug 01 14:25:57.595109 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 310/631] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:57 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:57.736953 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c3ecffdd-4c04-4f32-ad59-dd6c598f16a9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:57.737510 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c3ecffdd-4c04-4f32-ad59-dd6c598f16a9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:57.744265 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c3ecffdd-4c04-4f32-ad59-dd6c598f16a9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:57.744905 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c3ecffdd-4c04-4f32-ad59-dd6c598f16a9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:57.750532 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c3ecffdd-4c04-4f32-ad59-dd6c598f16a9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:57.750532 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c3ecffdd-4c04-4f32-ad59-dd6c598f16a9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:57.933976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c3ecffdd-4c04-4f32-ad59-dd6c598f16a9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:57.943105 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c3ecffdd-4c04-4f32-ad59-dd6c598f16a9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:57.944581 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c3ecffdd-4c04-4f32-ad59-dd6c598f16a9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:57.946271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c3ecffdd-4c04-4f32-ad59-dd6c598f16a9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1407 microversion: 2.20 time: 0.213865 Aug 01 14:25:57.947019 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 322/632] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:57 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:58.619097 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-389e8adb-645e-4295-aeba-72c4996662b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:58.621466 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-389e8adb-645e-4295-aeba-72c4996662b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:58.630523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-389e8adb-645e-4295-aeba-72c4996662b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:58.631930 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-389e8adb-645e-4295-aeba-72c4996662b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:58.639458 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-389e8adb-645e-4295-aeba-72c4996662b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:58.639458 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-389e8adb-645e-4295-aeba-72c4996662b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:58.704866 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-389e8adb-645e-4295-aeba-72c4996662b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:58.717602 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-389e8adb-645e-4295-aeba-72c4996662b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1233 microversion: 2.1 time: 0.104721 Aug 01 14:25:58.719354 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 311/633] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:58 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1233 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:25:58.970760 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-2e1f860e-68ac-41a8-84a4-bcef87cd985d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:58.971377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-2e1f860e-68ac-41a8-84a4-bcef87cd985d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:58.979835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2e1f860e-68ac-41a8-84a4-bcef87cd985d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:58.980827 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2e1f860e-68ac-41a8-84a4-bcef87cd985d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:58.981691 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2e1f860e-68ac-41a8-84a4-bcef87cd985d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:58.982171 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2e1f860e-68ac-41a8-84a4-bcef87cd985d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:59.134053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2e1f860e-68ac-41a8-84a4-bcef87cd985d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:59.142558 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2e1f860e-68ac-41a8-84a4-bcef87cd985d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:59.144069 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2e1f860e-68ac-41a8-84a4-bcef87cd985d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:59.145238 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-2e1f860e-68ac-41a8-84a4-bcef87cd985d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1599 microversion: 2.20 time: 0.179905 Aug 01 14:25:59.152970 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 323/634] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:25:58 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1599 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:25:59.173257 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-65719e40-b77a-4c42-821d-fd0e2b6b8e46 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:59.174062 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-65719e40-b77a-4c42-821d-fd0e2b6b8e46 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:59.181301 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-65719e40-b77a-4c42-821d-fd0e2b6b8e46 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:59.182026 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-65719e40-b77a-4c42-821d-fd0e2b6b8e46 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:59.182863 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-65719e40-b77a-4c42-821d-fd0e2b6b8e46 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:59.183194 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-65719e40-b77a-4c42-821d-fd0e2b6b8e46 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:59.304241 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-65719e40-b77a-4c42-821d-fd0e2b6b8e46 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.136239 Aug 01 14:25:59.305132 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 312/635] 10.222.0.49 () {60 vars in 1316 bytes} [Mon Aug 1 14:25:59 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:25:59.744573 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b480540b-6aaa-4f05-8633-39ed8acf40b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:25:59.746755 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b480540b-6aaa-4f05-8633-39ed8acf40b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:25:59.765927 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b480540b-6aaa-4f05-8633-39ed8acf40b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:59.766258 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b480540b-6aaa-4f05-8633-39ed8acf40b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:59.772485 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b480540b-6aaa-4f05-8633-39ed8acf40b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:25:59.773271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b480540b-6aaa-4f05-8633-39ed8acf40b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:25:59.969905 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b480540b-6aaa-4f05-8633-39ed8acf40b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:25:59.979592 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b480540b-6aaa-4f05-8633-39ed8acf40b5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1307 microversion: 2.1 time: 0.243894 Aug 01 14:25:59.983340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 324/636] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:25:59 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1307 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:00.699867 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-7fe0d3af-6c20-4ae9-bf82-60fe2487e5bf req-5d437367-e91d-4001-a580-a8c35d8e633d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "015b4877-f47b-4e45-a2b8-e36ba4bacf82", "tag": "09014052-8b79-46d5-99ce-d8c6b6ccd445"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:00.714678 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-7fe0d3af-6c20-4ae9-bf82-60fe2487e5bf req-5d437367-e91d-4001-a580-a8c35d8e633d service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:00.715516 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-7fe0d3af-6c20-4ae9-bf82-60fe2487e5bf req-5d437367-e91d-4001-a580-a8c35d8e633d service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:00.729069 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-7fe0d3af-6c20-4ae9-bf82-60fe2487e5bf req-5d437367-e91d-4001-a580-a8c35d8e633d service nova] Creating event network-changed:09014052-8b79-46d5-99ce-d8c6b6ccd445 for instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 on hv-cinder-78729 Aug 01 14:26:00.735461 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-7fe0d3af-6c20-4ae9-bf82-60fe2487e5bf req-5d437367-e91d-4001-a580-a8c35d8e633d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039655 Aug 01 14:26:00.736729 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 313/637] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:01.001733 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ba3abd76-81f1-4cb6-b705-2ad2b3280706 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:01.003783 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ba3abd76-81f1-4cb6-b705-2ad2b3280706 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:01.012004 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ba3abd76-81f1-4cb6-b705-2ad2b3280706 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:01.012812 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ba3abd76-81f1-4cb6-b705-2ad2b3280706 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:01.014543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ba3abd76-81f1-4cb6-b705-2ad2b3280706 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:01.015283 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ba3abd76-81f1-4cb6-b705-2ad2b3280706 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:01.103130 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ba3abd76-81f1-4cb6-b705-2ad2b3280706 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:01.112212 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ba3abd76-81f1-4cb6-b705-2ad2b3280706 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1295 microversion: 2.1 time: 0.115432 Aug 01 14:26:01.119105 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 325/638] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:00 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1295 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:02.136106 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4335bd8f-41dc-4555-93f7-4eac04e283ba tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:02.136944 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4335bd8f-41dc-4555-93f7-4eac04e283ba tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:02.143992 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4335bd8f-41dc-4555-93f7-4eac04e283ba tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:02.144740 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4335bd8f-41dc-4555-93f7-4eac04e283ba tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:02.145735 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4335bd8f-41dc-4555-93f7-4eac04e283ba tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:02.146358 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4335bd8f-41dc-4555-93f7-4eac04e283ba tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:02.296500 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4335bd8f-41dc-4555-93f7-4eac04e283ba tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:02.305983 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4335bd8f-41dc-4555-93f7-4eac04e283ba tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1362 microversion: 2.1 time: 0.174898 Aug 01 14:26:02.318029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 314/639] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:02 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:03.330110 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-cef6b32b-da9b-4715-b797-f0cfe9e5234e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:03.331564 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-cef6b32b-da9b-4715-b797-f0cfe9e5234e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:03.338813 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cef6b32b-da9b-4715-b797-f0cfe9e5234e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:03.339266 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cef6b32b-da9b-4715-b797-f0cfe9e5234e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:03.340238 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cef6b32b-da9b-4715-b797-f0cfe9e5234e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:03.340731 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cef6b32b-da9b-4715-b797-f0cfe9e5234e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:03.494808 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-cef6b32b-da9b-4715-b797-f0cfe9e5234e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:03.506404 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-cef6b32b-da9b-4715-b797-f0cfe9e5234e tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1362 microversion: 2.1 time: 0.181573 Aug 01 14:26:03.520991 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 326/640] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:03 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:03.748709 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-b0f88f9c-a440-4fc9-9769-9e511d55264a req-339487dc-0e90-4b02-b17b-d820fe77b223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769a38d5-5ba3-41fd-b56b-eb5a2081bb11", "tag": "2334a6a5-d2f6-461e-a84a-258925a8b08c"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:03.759553 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-b0f88f9c-a440-4fc9-9769-9e511d55264a req-339487dc-0e90-4b02-b17b-d820fe77b223 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:03.760231 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-b0f88f9c-a440-4fc9-9769-9e511d55264a req-339487dc-0e90-4b02-b17b-d820fe77b223 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:03.776218 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-b0f88f9c-a440-4fc9-9769-9e511d55264a req-339487dc-0e90-4b02-b17b-d820fe77b223 service nova] Creating event network-changed:2334a6a5-d2f6-461e-a84a-258925a8b08c for instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 on hv-cinder-78729 Aug 01 14:26:03.787844 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-b0f88f9c-a440-4fc9-9769-9e511d55264a req-339487dc-0e90-4b02-b17b-d820fe77b223 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.310955 Aug 01 14:26:03.789325 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 315/641] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:04.531446 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-dec0b4ac-6e7d-4e70-81b1-8a6082ba8b95 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:04.532777 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-dec0b4ac-6e7d-4e70-81b1-8a6082ba8b95 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:04.541604 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dec0b4ac-6e7d-4e70-81b1-8a6082ba8b95 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:04.542086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dec0b4ac-6e7d-4e70-81b1-8a6082ba8b95 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:04.543084 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dec0b4ac-6e7d-4e70-81b1-8a6082ba8b95 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:04.543698 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-dec0b4ac-6e7d-4e70-81b1-8a6082ba8b95 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:04.696745 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-dec0b4ac-6e7d-4e70-81b1-8a6082ba8b95 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:04.710077 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-dec0b4ac-6e7d-4e70-81b1-8a6082ba8b95 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1362 microversion: 2.1 time: 0.181475 Aug 01 14:26:04.710077 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 327/642] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:04 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:05.728677 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-07261a9c-317e-42e1-a961-3827981ef98d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:05.729400 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-07261a9c-317e-42e1-a961-3827981ef98d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:05.736284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-07261a9c-317e-42e1-a961-3827981ef98d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:05.736742 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-07261a9c-317e-42e1-a961-3827981ef98d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:05.737518 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-07261a9c-317e-42e1-a961-3827981ef98d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:05.738008 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-07261a9c-317e-42e1-a961-3827981ef98d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:05.920818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-07261a9c-317e-42e1-a961-3827981ef98d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:05.934333 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-07261a9c-317e-42e1-a961-3827981ef98d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1362 microversion: 2.1 time: 0.210351 Aug 01 14:26:05.934916 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 316/643] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:05 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:06.099471 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c14392d2-1da3-4b91-bd24-34ad99df0559 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Action: 'create', calling method: .version_select at 0x7fb24f78eee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2088558392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJoS5GgUCTiFYPzU1iZFC6g5Qf9UNboVEodX9/RX3ww/KHb17yv/zABaJObYQBLMlzn6uNLUQaMbb6ScFGBhCE8er8u65NP6S13x4gojJdT63JdsEVwciuIBkOkWcY8xw=="}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:06.115204 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-c14392d2-1da3-4b91-bd24-34ad99df0559 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Getting quotas for project c982cea0e664473ca8df5da87fbe6d73. Resources: {'key_pairs'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:26:06.119401 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-c14392d2-1da3-4b91-bd24-34ad99df0559 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Getting quotas for user cb2ef56494054dd2ac1c18bee82f2a25 and project c982cea0e664473ca8df5da87fbe6d73. Resources: {'key_pairs'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:26:06.121695 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=2 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:06.211517 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c14392d2-1da3-4b91-bd24-34ad99df0559 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.235863 Aug 01 14:26:06.212120 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 328/644] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Aug 1 14:26:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:06.381931 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d83dbede-8c64-4dca-91c0-7ad5d7517043 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:06.382428 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d83dbede-8c64-4dca-91c0-7ad5d7517043 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:06.388545 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d83dbede-8c64-4dca-91c0-7ad5d7517043 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:06.389886 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d83dbede-8c64-4dca-91c0-7ad5d7517043 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:06.390319 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d83dbede-8c64-4dca-91c0-7ad5d7517043 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:06.390757 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d83dbede-8c64-4dca-91c0-7ad5d7517043 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:06.470912 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-d83dbede-8c64-4dca-91c0-7ad5d7517043 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lazy-loading 'services' on Instance uuid eff34e0e-c728-4ffb-8eba-169ede959890 {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:26:06.474584 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=12 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:06.695030 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d83dbede-8c64-4dca-91c0-7ad5d7517043 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "DELETE /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-volume_attachments/afbfa596-f8eb-4ebf-a11a-4b7854a9f9cf" status: 202 len: 0 microversion: 2.1 time: 0.316886 Aug 01 14:26:06.695968 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 317/645] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Aug 1 14:26:06 2022] DELETE /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-volume_attachments/afbfa596-f8eb-4ebf-a11a-4b7854a9f9cf => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:26:06.705224 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-62a52392-a789-4410-8cd5-e25b85f0808a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:06.707459 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-62a52392-a789-4410-8cd5-e25b85f0808a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:06.714373 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-62a52392-a789-4410-8cd5-e25b85f0808a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:06.714835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-62a52392-a789-4410-8cd5-e25b85f0808a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:06.719115 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-62a52392-a789-4410-8cd5-e25b85f0808a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:06.719115 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-62a52392-a789-4410-8cd5-e25b85f0808a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:06.750407 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-62a52392-a789-4410-8cd5-e25b85f0808a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049842 Aug 01 14:26:06.755838 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 329/646] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:26:06 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:06.968170 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-bc1696a4-9ade-45aa-85c4-7faf38dc87f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:06.969007 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-bc1696a4-9ade-45aa-85c4-7faf38dc87f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:06.975441 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bc1696a4-9ade-45aa-85c4-7faf38dc87f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:06.976034 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bc1696a4-9ade-45aa-85c4-7faf38dc87f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:06.979543 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bc1696a4-9ade-45aa-85c4-7faf38dc87f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:06.979543 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bc1696a4-9ade-45aa-85c4-7faf38dc87f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:07.155306 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-bc1696a4-9ade-45aa-85c4-7faf38dc87f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:07.165711 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-bc1696a4-9ade-45aa-85c4-7faf38dc87f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1362 microversion: 2.1 time: 0.202774 Aug 01 14:26:07.166507 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 318/647] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:06 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:07.762761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-5930d7c1-9ec8-477a-983e-c83dd32664a4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:07.768022 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-5930d7c1-9ec8-477a-983e-c83dd32664a4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:07.773535 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5930d7c1-9ec8-477a-983e-c83dd32664a4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:07.774125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5930d7c1-9ec8-477a-983e-c83dd32664a4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:07.774991 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5930d7c1-9ec8-477a-983e-c83dd32664a4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:07.776119 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5930d7c1-9ec8-477a-983e-c83dd32664a4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:07.812698 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-5930d7c1-9ec8-477a-983e-c83dd32664a4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054175 Aug 01 14:26:07.813597 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 330/648] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:26:07 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:08.187540 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c6b5ca2f-731f-4b34-99be-b8ac372d32d4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:08.188281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c6b5ca2f-731f-4b34-99be-b8ac372d32d4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:08.194838 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c6b5ca2f-731f-4b34-99be-b8ac372d32d4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:08.195291 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c6b5ca2f-731f-4b34-99be-b8ac372d32d4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:08.196105 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c6b5ca2f-731f-4b34-99be-b8ac372d32d4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:08.196534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c6b5ca2f-731f-4b34-99be-b8ac372d32d4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:08.379180 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c6b5ca2f-731f-4b34-99be-b8ac372d32d4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:08.387061 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c6b5ca2f-731f-4b34-99be-b8ac372d32d4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1362 microversion: 2.1 time: 0.203692 Aug 01 14:26:08.387758 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 319/649] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:08 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:08.824774 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1424c66b-f97d-4087-b843-ab2c74b68b1c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:08.827677 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1424c66b-f97d-4087-b843-ab2c74b68b1c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:08.834619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1424c66b-f97d-4087-b843-ab2c74b68b1c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:08.835098 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1424c66b-f97d-4087-b843-ab2c74b68b1c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:08.836071 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1424c66b-f97d-4087-b843-ab2c74b68b1c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:08.836514 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1424c66b-f97d-4087-b843-ab2c74b68b1c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:08.871673 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1424c66b-f97d-4087-b843-ab2c74b68b1c tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050816 Aug 01 14:26:08.872412 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 331/650] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:26:08 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:26:08.964912 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b5dd07df-2a26-43c3-b522-4ea28658fc1f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:08.965424 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b5dd07df-2a26-43c3-b522-4ea28658fc1f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:08.972219 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b5dd07df-2a26-43c3-b522-4ea28658fc1f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:08.972625 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b5dd07df-2a26-43c3-b522-4ea28658fc1f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:08.973517 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b5dd07df-2a26-43c3-b522-4ea28658fc1f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:08.973996 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b5dd07df-2a26-43c3-b522-4ea28658fc1f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:09.003739 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b5dd07df-2a26-43c3-b522-4ea28658fc1f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Going to try to terminate instance {{(pid=118246) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:26:09.123995 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:09.250772 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b5dd07df-2a26-43c3-b522-4ea28658fc1f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "DELETE /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 204 len: 0 microversion: 2.1 time: 0.293617 Aug 01 14:26:09.251411 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 320/651] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:26:08 2022] DELETE /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:26:09.260748 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d17d7b2f-aa0a-48bc-8ba1-466639366fcd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:09.264378 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d17d7b2f-aa0a-48bc-8ba1-466639366fcd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:09.270815 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d17d7b2f-aa0a-48bc-8ba1-466639366fcd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:09.271493 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d17d7b2f-aa0a-48bc-8ba1-466639366fcd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:09.272577 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d17d7b2f-aa0a-48bc-8ba1-466639366fcd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:09.273361 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d17d7b2f-aa0a-48bc-8ba1-466639366fcd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:09.409898 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5b101dc4-a0fd-472b-b1e9-6f8c863c4eb6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:09.410701 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5b101dc4-a0fd-472b-b1e9-6f8c863c4eb6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:09.421903 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5b101dc4-a0fd-472b-b1e9-6f8c863c4eb6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:09.422065 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d17d7b2f-aa0a-48bc-8ba1-466639366fcd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:09.422184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5b101dc4-a0fd-472b-b1e9-6f8c863c4eb6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:09.422184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5b101dc4-a0fd-472b-b1e9-6f8c863c4eb6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:09.422332 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5b101dc4-a0fd-472b-b1e9-6f8c863c4eb6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:09.428995 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d17d7b2f-aa0a-48bc-8ba1-466639366fcd tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1689 microversion: 2.1 time: 0.173191 Aug 01 14:26:09.429582 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 332/652] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:09 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:09.566688 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-5b101dc4-a0fd-472b-b1e9-6f8c863c4eb6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:09.574490 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5b101dc4-a0fd-472b-b1e9-6f8c863c4eb6 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1362 microversion: 2.1 time: 0.168818 Aug 01 14:26:09.575012 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 321/653] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:09 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:10.307189 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-0a7277e4-f96e-47c1-a8ff-2f18cf067bde req-9231113a-616c-480a-8584-1c05b0028a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769a38d5-5ba3-41fd-b56b-eb5a2081bb11", "name": "network-vif-plugged", "status": "completed", "tag": "2334a6a5-d2f6-461e-a84a-258925a8b08c"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:10.320153 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-0a7277e4-f96e-47c1-a8ff-2f18cf067bde req-9231113a-616c-480a-8584-1c05b0028a37 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:10.320604 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-0a7277e4-f96e-47c1-a8ff-2f18cf067bde req-9231113a-616c-480a-8584-1c05b0028a37 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:10.334234 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-0a7277e4-f96e-47c1-a8ff-2f18cf067bde req-9231113a-616c-480a-8584-1c05b0028a37 service nova] Creating event network-vif-plugged:2334a6a5-d2f6-461e-a84a-258925a8b08c for instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 on hv-cinder-78729 Aug 01 14:26:10.339995 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-0a7277e4-f96e-47c1-a8ff-2f18cf067bde req-9231113a-616c-480a-8584-1c05b0028a37 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037647 Aug 01 14:26:10.344230 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 333/654] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:10.456985 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-14c56069-2b6a-4957-bce5-2e37613741d3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:10.460344 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-14c56069-2b6a-4957-bce5-2e37613741d3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:10.464546 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-14c56069-2b6a-4957-bce5-2e37613741d3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:10.465004 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-14c56069-2b6a-4957-bce5-2e37613741d3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:10.465856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-14c56069-2b6a-4957-bce5-2e37613741d3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:10.466261 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-14c56069-2b6a-4957-bce5-2e37613741d3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:10.597959 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1c9db0b5-f033-428b-8afd-ff6e0f9f2529 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:10.599208 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1c9db0b5-f033-428b-8afd-ff6e0f9f2529 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:10.612050 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1c9db0b5-f033-428b-8afd-ff6e0f9f2529 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:10.612656 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1c9db0b5-f033-428b-8afd-ff6e0f9f2529 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:10.613602 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-14c56069-2b6a-4957-bce5-2e37613741d3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:10.613888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1c9db0b5-f033-428b-8afd-ff6e0f9f2529 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:10.614711 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1c9db0b5-f033-428b-8afd-ff6e0f9f2529 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:10.638694 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-14c56069-2b6a-4957-bce5-2e37613741d3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1689 microversion: 2.1 time: 0.185660 Aug 01 14:26:10.639279 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 322/655] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:10 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:10.775676 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1c9db0b5-f033-428b-8afd-ff6e0f9f2529 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:10.784331 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1c9db0b5-f033-428b-8afd-ff6e0f9f2529 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1362 microversion: 2.1 time: 0.191031 Aug 01 14:26:10.789263 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 334/656] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:10 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:11.660297 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8e5a1e94-8331-464d-b729-b24279f09595 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:11.660911 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8e5a1e94-8331-464d-b729-b24279f09595 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:11.667563 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8e5a1e94-8331-464d-b729-b24279f09595 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:11.668025 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8e5a1e94-8331-464d-b729-b24279f09595 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:11.668869 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8e5a1e94-8331-464d-b729-b24279f09595 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:11.669311 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8e5a1e94-8331-464d-b729-b24279f09595 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:11.810558 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b4b02a06-3ce1-4305-94f8-ca8e6ac003c4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:11.811254 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b4b02a06-3ce1-4305-94f8-ca8e6ac003c4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:11.811503 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8e5a1e94-8331-464d-b729-b24279f09595 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:11.817446 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b4b02a06-3ce1-4305-94f8-ca8e6ac003c4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:11.817998 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b4b02a06-3ce1-4305-94f8-ca8e6ac003c4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:11.818991 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8e5a1e94-8331-464d-b729-b24279f09595 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1689 microversion: 2.1 time: 0.162699 Aug 01 14:26:11.819107 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b4b02a06-3ce1-4305-94f8-ca8e6ac003c4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:11.819433 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b4b02a06-3ce1-4305-94f8-ca8e6ac003c4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:11.830406 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 323/657] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:11 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:11.975826 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b4b02a06-3ce1-4305-94f8-ca8e6ac003c4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:11.984209 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b4b02a06-3ce1-4305-94f8-ca8e6ac003c4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1362 microversion: 2.1 time: 0.177463 Aug 01 14:26:11.984776 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 335/658] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:11 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:12.841070 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c1643edc-6589-498c-a45a-ecfb78516c4f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:12.842798 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c1643edc-6589-498c-a45a-ecfb78516c4f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:12.849573 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c1643edc-6589-498c-a45a-ecfb78516c4f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:12.850078 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c1643edc-6589-498c-a45a-ecfb78516c4f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:12.850852 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c1643edc-6589-498c-a45a-ecfb78516c4f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:12.851291 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c1643edc-6589-498c-a45a-ecfb78516c4f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:12.987361 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c1643edc-6589-498c-a45a-ecfb78516c4f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:12.995489 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c1643edc-6589-498c-a45a-ecfb78516c4f tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1689 microversion: 2.1 time: 0.159155 Aug 01 14:26:12.996161 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 324/659] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:12 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:13.014930 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-27847cda-8606-42a2-8b68-28aff240104a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:13.015630 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-27847cda-8606-42a2-8b68-28aff240104a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:13.024263 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:13.030545 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-27847cda-8606-42a2-8b68-28aff240104a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:13.031041 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-27847cda-8606-42a2-8b68-28aff240104a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:13.031929 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-27847cda-8606-42a2-8b68-28aff240104a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:13.032374 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-27847cda-8606-42a2-8b68-28aff240104a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:13.037148 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=100 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:13.170895 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-27847cda-8606-42a2-8b68-28aff240104a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:13.179041 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-27847cda-8606-42a2-8b68-28aff240104a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1362 microversion: 2.1 time: 0.178109 Aug 01 14:26:13.179664 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 336/660] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:12 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:14.018456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b36ecc4b-18cc-4b76-92a3-f66a4fee5dc4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:14.019258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b36ecc4b-18cc-4b76-92a3-f66a4fee5dc4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:14.026698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b36ecc4b-18cc-4b76-92a3-f66a4fee5dc4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:14.027149 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b36ecc4b-18cc-4b76-92a3-f66a4fee5dc4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:14.027923 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b36ecc4b-18cc-4b76-92a3-f66a4fee5dc4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:14.028369 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b36ecc4b-18cc-4b76-92a3-f66a4fee5dc4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:14.115518 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-b36ecc4b-18cc-4b76-92a3-f66a4fee5dc4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:14.127162 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b36ecc4b-18cc-4b76-92a3-f66a4fee5dc4 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1621 microversion: 2.1 time: 0.114107 Aug 01 14:26:14.130243 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 325/661] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:14 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1621 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:14.200253 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3307e955-9250-4be9-9953-ba78788da6c5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:14.200951 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3307e955-9250-4be9-9953-ba78788da6c5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:14.207497 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3307e955-9250-4be9-9953-ba78788da6c5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:14.208113 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3307e955-9250-4be9-9953-ba78788da6c5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:14.208899 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3307e955-9250-4be9-9953-ba78788da6c5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:14.209372 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3307e955-9250-4be9-9953-ba78788da6c5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:14.349418 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3307e955-9250-4be9-9953-ba78788da6c5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:14.358036 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3307e955-9250-4be9-9953-ba78788da6c5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1362 microversion: 2.1 time: 0.160670 Aug 01 14:26:14.358885 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 337/662] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:14 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:14.387122 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-05b42594-20b0-49f5-a0f9-f96c5738f37a req-5d01edcf-1740-4b50-b5ad-8f692b303884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff34e0e-c728-4ffb-8eba-169ede959890", "name": "network-vif-deleted", "tag": "1e5c663d-f700-413f-aae1-9880c79000d4"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:14.396647 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-05b42594-20b0-49f5-a0f9-f96c5738f37a req-5d01edcf-1740-4b50-b5ad-8f692b303884 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:14.397090 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-05b42594-20b0-49f5-a0f9-f96c5738f37a req-5d01edcf-1740-4b50-b5ad-8f692b303884 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:14.408315 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-05b42594-20b0-49f5-a0f9-f96c5738f37a req-5d01edcf-1740-4b50-b5ad-8f692b303884 service nova] Creating event network-vif-deleted:1e5c663d-f700-413f-aae1-9880c79000d4 for instance eff34e0e-c728-4ffb-8eba-169ede959890 on hv-cinder-78729 Aug 01 14:26:14.413327 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-05b42594-20b0-49f5-a0f9-f96c5738f37a req-5d01edcf-1740-4b50-b5ad-8f692b303884 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029817 Aug 01 14:26:14.414106 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 326/663] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:26:15.150025 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-9cfa764e-c456-46cb-b08a-dac2c809c16d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:15.150668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-9cfa764e-c456-46cb-b08a-dac2c809c16d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:15.157786 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9cfa764e-c456-46cb-b08a-dac2c809c16d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:15.158237 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9cfa764e-c456-46cb-b08a-dac2c809c16d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:15.159035 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9cfa764e-c456-46cb-b08a-dac2c809c16d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:15.159491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9cfa764e-c456-46cb-b08a-dac2c809c16d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:15.195159 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9cfa764e-c456-46cb-b08a-dac2c809c16d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:15.195606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9cfa764e-c456-46cb-b08a-dac2c809c16d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:15.196062 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-9cfa764e-c456-46cb-b08a-dac2c809c16d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lazy-loading 'fault' on Instance uuid eff34e0e-c728-4ffb-8eba-169ede959890 {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:26:15.243881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-9cfa764e-c456-46cb-b08a-dac2c809c16d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:15.251950 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-9cfa764e-c456-46cb-b08a-dac2c809c16d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 200 len: 1334 microversion: 2.1 time: 0.105846 Aug 01 14:26:15.252519 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 338/664] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:15 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 1334 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:15.382380 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-25b0c156-d0b5-48f8-b7eb-97aea266761a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:15.383069 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-25b0c156-d0b5-48f8-b7eb-97aea266761a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:15.386136 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:15.393103 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-25b0c156-d0b5-48f8-b7eb-97aea266761a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:15.393565 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-25b0c156-d0b5-48f8-b7eb-97aea266761a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:15.394444 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-25b0c156-d0b5-48f8-b7eb-97aea266761a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:15.394927 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-25b0c156-d0b5-48f8-b7eb-97aea266761a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:15.559343 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-25b0c156-d0b5-48f8-b7eb-97aea266761a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:15.567788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-25b0c156-d0b5-48f8-b7eb-97aea266761a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1362 microversion: 2.1 time: 0.189947 Aug 01 14:26:15.568459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 327/665] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:15 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:16.277206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-aff730ea-e3d3-4f79-89f9-e0f52719263a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:16.277994 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-aff730ea-e3d3-4f79-89f9-e0f52719263a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: eff34e0e-c728-4ffb-8eba-169ede959890] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:16.280077 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=10 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:16.286105 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-aff730ea-e3d3-4f79-89f9-e0f52719263a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:16.286554 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-aff730ea-e3d3-4f79-89f9-e0f52719263a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:16.287329 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-aff730ea-e3d3-4f79-89f9-e0f52719263a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:16.287760 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-aff730ea-e3d3-4f79-89f9-e0f52719263a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:16.301304 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-aff730ea-e3d3-4f79-89f9-e0f52719263a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] HTTP exception thrown: Instance eff34e0e-c728-4ffb-8eba-169ede959890 could not be found. Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-aff730ea-e3d3-4f79-89f9-e0f52719263a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Request method failure captured: Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 HTTP/1.1 Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-E4_d12P1yLmeAi6iRzWLrJoqCmtM2x-aOg__n743TyqbmpKOWkckS8c7k87mJ7g9R1SSYLqx8F7V6s4r-ccgea6VgW8gApwCdGP9EruZPZ0fjTAqXY6MSyeImK19uptwGcDBuAzC8kp39QF0SDqE5zKBuWPoWoccfhbA-KPOePrK4 Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: c80bd4eb290541d8a713ea5ba60d0de4 Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1518303562 Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:26:16.303169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:26:16.304728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:26:16.304728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1518303562 Aug 01 14:26:16.304728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: c80bd4eb290541d8a713ea5ba60d0de4 Aug 01 14:26:16.304728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1518303562 Aug 01 14:26:16.304728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-ServerRescueNegativeTestJSON-1518303562-project Aug 01 14:26:16.304728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:26:16.304728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:26:16.304728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: 6b46ac5a29594c41a83e70838b0a13c8 Aug 01 14:26:16.304728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1518303562-project Aug 01 14:26:16.304728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:26:16.304728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance eff34e0e-c728-4ffb-8eba-169ede959890 could not be found. Aug 01 14:26:16.304728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': 'eff34e0e-c728-4ffb-8eba-169ede959890'} Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eff34e0e-c728-4ffb-8eba-169ede959890 could not be found. Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:26:16.305605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eff34e0e-c728-4ffb-8eba-169ede959890 could not be found. Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eff34e0e-c728-4ffb-8eba-169ede959890 could not be found. Aug 01 14:26:16.306948 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:16.308538 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-aff730ea-e3d3-4f79-89f9-e0f52719263a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Returning 404 to user: Instance eff34e0e-c728-4ffb-8eba-169ede959890 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:26:16.308538 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-aff730ea-e3d3-4f79-89f9-e0f52719263a tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890" status: 404 len: 111 microversion: 2.1 time: 0.031624 Aug 01 14:26:16.308538 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 339/666] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:16 2022] GET /compute/v2.1/servers/eff34e0e-c728-4ffb-8eba-169ede959890 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:26:16.314296 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-94cfb90f-51fb-4ee6-9875-7af6ec3f8ad0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '.version_select at 0x7fb24ef573a0>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:16.422759 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-94cfb90f-51fb-4ee6-9875-7af6ec3f8ad0 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-928547737" status: 202 len: 0 microversion: 2.1 time: 0.113032 Aug 01 14:26:16.423863 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 328/667] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Aug 1 14:26:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-928547737 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:26:16.589034 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a8d5f6cf-88d1-4957-90eb-39b15f003bca tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:16.589647 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a8d5f6cf-88d1-4957-90eb-39b15f003bca tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:16.597656 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a8d5f6cf-88d1-4957-90eb-39b15f003bca tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:16.598141 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a8d5f6cf-88d1-4957-90eb-39b15f003bca tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:16.598957 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a8d5f6cf-88d1-4957-90eb-39b15f003bca tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:16.599400 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a8d5f6cf-88d1-4957-90eb-39b15f003bca tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:16.745550 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a8d5f6cf-88d1-4957-90eb-39b15f003bca tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:16.755004 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a8d5f6cf-88d1-4957-90eb-39b15f003bca tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1549 microversion: 2.1 time: 0.170243 Aug 01 14:26:16.755908 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 340/668] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:16 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:16.778507 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-10e9b7eb-95dd-4ba6-84bd-bec573cf93df tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:16.782008 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-10e9b7eb-95dd-4ba6-84bd-bec573cf93df tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:16.791361 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-10e9b7eb-95dd-4ba6-84bd-bec573cf93df tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:16.791910 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-10e9b7eb-95dd-4ba6-84bd-bec573cf93df tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:16.792936 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-10e9b7eb-95dd-4ba6-84bd-bec573cf93df tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:16.793450 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-10e9b7eb-95dd-4ba6-84bd-bec573cf93df tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:16.874833 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-10e9b7eb-95dd-4ba6-84bd-bec573cf93df tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100672 Aug 01 14:26:16.875430 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 329/669] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Aug 1 14:26:16 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:26:18.296785 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-c6894e1b-a036-4425-9bb1-a4875519502c req-6d6b04f7-9a3a-4f53-9c80-cef5ef06182b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769a38d5-5ba3-41fd-b56b-eb5a2081bb11", "tag": "2334a6a5-d2f6-461e-a84a-258925a8b08c"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:18.306682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-c6894e1b-a036-4425-9bb1-a4875519502c req-6d6b04f7-9a3a-4f53-9c80-cef5ef06182b service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:18.307154 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-c6894e1b-a036-4425-9bb1-a4875519502c req-6d6b04f7-9a3a-4f53-9c80-cef5ef06182b service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:18.323347 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-c6894e1b-a036-4425-9bb1-a4875519502c req-6d6b04f7-9a3a-4f53-9c80-cef5ef06182b service nova] Creating event network-changed:2334a6a5-d2f6-461e-a84a-258925a8b08c for instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 on hv-cinder-78729 Aug 01 14:26:18.332361 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-c6894e1b-a036-4425-9bb1-a4875519502c req-6d6b04f7-9a3a-4f53-9c80-cef5ef06182b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105738 Aug 01 14:26:18.332985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 341/670] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:26:19.824526 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d16c288b-a15d-468c-9ece-6b4b3cd62238 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:19.825434 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d16c288b-a15d-468c-9ece-6b4b3cd62238 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:19.832159 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d16c288b-a15d-468c-9ece-6b4b3cd62238 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:19.832612 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d16c288b-a15d-468c-9ece-6b4b3cd62238 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:19.833366 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d16c288b-a15d-468c-9ece-6b4b3cd62238 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:19.833871 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d16c288b-a15d-468c-9ece-6b4b3cd62238 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:19.862753 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d16c288b-a15d-468c-9ece-6b4b3cd62238 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Going to try to terminate instance {{(pid=118246) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:26:20.146931 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d16c288b-a15d-468c-9ece-6b4b3cd62238 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 204 len: 0 microversion: 2.1 time: 0.326565 Aug 01 14:26:20.147541 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 330/671] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:26:19 2022] DELETE /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:26:20.156666 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e9330743-40cc-42db-8bbf-d4d06cab72d7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:20.157367 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e9330743-40cc-42db-8bbf-d4d06cab72d7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:20.163690 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e9330743-40cc-42db-8bbf-d4d06cab72d7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:20.164143 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e9330743-40cc-42db-8bbf-d4d06cab72d7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:20.164910 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e9330743-40cc-42db-8bbf-d4d06cab72d7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:20.165350 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e9330743-40cc-42db-8bbf-d4d06cab72d7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:20.302369 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e9330743-40cc-42db-8bbf-d4d06cab72d7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:20.311601 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e9330743-40cc-42db-8bbf-d4d06cab72d7 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1507 microversion: 2.1 time: 0.159625 Aug 01 14:26:20.312182 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 342/672] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:20 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:21.333408 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-a1a61b10-4150-4dd3-b866-d5ecbccd3c5e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:21.334063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-a1a61b10-4150-4dd3-b866-d5ecbccd3c5e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:21.340518 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a1a61b10-4150-4dd3-b866-d5ecbccd3c5e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:21.340966 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a1a61b10-4150-4dd3-b866-d5ecbccd3c5e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:21.342298 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a1a61b10-4150-4dd3-b866-d5ecbccd3c5e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:21.342793 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a1a61b10-4150-4dd3-b866-d5ecbccd3c5e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:21.479693 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a1a61b10-4150-4dd3-b866-d5ecbccd3c5e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:21.489992 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-a1a61b10-4150-4dd3-b866-d5ecbccd3c5e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1507 microversion: 2.1 time: 0.160736 Aug 01 14:26:21.490658 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 331/673] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:21 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:22.512130 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-76ac5244-24f6-431a-8a7f-43fab4609c0e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:22.512789 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-76ac5244-24f6-431a-8a7f-43fab4609c0e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:22.522507 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-76ac5244-24f6-431a-8a7f-43fab4609c0e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:22.522956 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-76ac5244-24f6-431a-8a7f-43fab4609c0e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:22.523825 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-76ac5244-24f6-431a-8a7f-43fab4609c0e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:22.524316 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-76ac5244-24f6-431a-8a7f-43fab4609c0e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:22.662741 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-76ac5244-24f6-431a-8a7f-43fab4609c0e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:22.674950 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-76ac5244-24f6-431a-8a7f-43fab4609c0e tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1507 microversion: 2.1 time: 0.166473 Aug 01 14:26:22.675883 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 343/674] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:22 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:22.689563 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-568b269d-d610-4fb7-87ef-2de995660781 req-a1bc1b74-a1c6-46d8-83e0-bf76c8c98a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4eb6448-faf6-4409-bc4d-591b29ab2e52", "name": "network-vif-deleted", "tag": "08093b92-1518-49dd-ab00-5865b4e9fb4f"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:22.700458 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-568b269d-d610-4fb7-87ef-2de995660781 req-a1bc1b74-a1c6-46d8-83e0-bf76c8c98a8b service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:22.700946 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-568b269d-d610-4fb7-87ef-2de995660781 req-a1bc1b74-a1c6-46d8-83e0-bf76c8c98a8b service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:22.712068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-568b269d-d610-4fb7-87ef-2de995660781 req-a1bc1b74-a1c6-46d8-83e0-bf76c8c98a8b service nova] Creating event network-vif-deleted:08093b92-1518-49dd-ab00-5865b4e9fb4f for instance b4eb6448-faf6-4409-bc4d-591b29ab2e52 on hv-cinder-78729 Aug 01 14:26:22.716993 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-568b269d-d610-4fb7-87ef-2de995660781 req-a1bc1b74-a1c6-46d8-83e0-bf76c8c98a8b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032255 Aug 01 14:26:22.717596 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 332/675] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:23.696407 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-34a5eb6f-aeb4-4e22-a03f-c9ee1c6ea7de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:23.697003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-34a5eb6f-aeb4-4e22-a03f-c9ee1c6ea7de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:23.703535 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-34a5eb6f-aeb4-4e22-a03f-c9ee1c6ea7de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:23.703990 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-34a5eb6f-aeb4-4e22-a03f-c9ee1c6ea7de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:23.704758 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-34a5eb6f-aeb4-4e22-a03f-c9ee1c6ea7de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:23.705202 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-34a5eb6f-aeb4-4e22-a03f-c9ee1c6ea7de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:23.736888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-34a5eb6f-aeb4-4e22-a03f-c9ee1c6ea7de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:23.737342 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-34a5eb6f-aeb4-4e22-a03f-c9ee1c6ea7de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:23.737835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-34a5eb6f-aeb4-4e22-a03f-c9ee1c6ea7de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lazy-loading 'fault' on Instance uuid b4eb6448-faf6-4409-bc4d-591b29ab2e52 {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:26:23.787368 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-34a5eb6f-aeb4-4e22-a03f-c9ee1c6ea7de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:23.795877 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-34a5eb6f-aeb4-4e22-a03f-c9ee1c6ea7de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 200 len: 1311 microversion: 2.1 time: 0.102129 Aug 01 14:26:23.796456 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 344/676] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:23 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:24.818146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5fa7a999-711b-4850-a607-067196b026a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:24.818847 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5fa7a999-711b-4850-a607-067196b026a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: b4eb6448-faf6-4409-bc4d-591b29ab2e52] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:24.825064 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5fa7a999-711b-4850-a607-067196b026a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:24.825556 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5fa7a999-711b-4850-a607-067196b026a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:24.826727 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5fa7a999-711b-4850-a607-067196b026a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:24.827173 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5fa7a999-711b-4850-a607-067196b026a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:24.840445 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-5fa7a999-711b-4850-a607-067196b026a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] HTTP exception thrown: Instance b4eb6448-faf6-4409-bc4d-591b29ab2e52 could not be found. Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5fa7a999-711b-4850-a607-067196b026a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Request method failure captured: Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 HTTP/1.1 Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-E4_d12P1yLmeAi6iRzWLrJoqCmtM2x-aOg__n743TyqbmpKOWkckS8c7k87mJ7g9R1SSYLqx8F7V6s4r-ccgea6VgW8gApwCdGP9EruZPZ0fjTAqXY6MSyeImK19uptwGcDBuAzC8kp39QF0SDqE5zKBuWPoWoccfhbA-KPOePrK4 Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: c80bd4eb290541d8a713ea5ba60d0de4 Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1518303562 Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:26:24.842683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:26:24.844258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:26:24.844258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1518303562 Aug 01 14:26:24.844258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: c80bd4eb290541d8a713ea5ba60d0de4 Aug 01 14:26:24.844258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1518303562 Aug 01 14:26:24.844258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-ServerRescueNegativeTestJSON-1518303562-project Aug 01 14:26:24.844258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:26:24.844258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:26:24.844258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: 6b46ac5a29594c41a83e70838b0a13c8 Aug 01 14:26:24.844258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1518303562-project Aug 01 14:26:24.844258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:26:24.844258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance b4eb6448-faf6-4409-bc4d-591b29ab2e52 could not be found. Aug 01 14:26:24.844258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': 'b4eb6448-faf6-4409-bc4d-591b29ab2e52'} Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4eb6448-faf6-4409-bc4d-591b29ab2e52 could not be found. Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:26:24.845063 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4eb6448-faf6-4409-bc4d-591b29ab2e52 could not be found. Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4eb6448-faf6-4409-bc4d-591b29ab2e52 could not be found. Aug 01 14:26:24.846363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:24.847486 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5fa7a999-711b-4850-a607-067196b026a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Returning 404 to user: Instance b4eb6448-faf6-4409-bc4d-591b29ab2e52 could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:26:24.847486 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5fa7a999-711b-4850-a607-067196b026a6 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52" status: 404 len: 111 microversion: 2.1 time: 0.030874 Aug 01 14:26:24.847486 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 333/677] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:24 2022] GET /compute/v2.1/servers/b4eb6448-faf6-4409-bc4d-591b29ab2e52 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:26:24.853567 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e99d00f1-bdc9-406c-9587-bbde5edbb0da tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:24.854134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e99d00f1-bdc9-406c-9587-bbde5edbb0da tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:24.861371 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e99d00f1-bdc9-406c-9587-bbde5edbb0da tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:24.861868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e99d00f1-bdc9-406c-9587-bbde5edbb0da tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:24.862638 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e99d00f1-bdc9-406c-9587-bbde5edbb0da tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:24.863078 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e99d00f1-bdc9-406c-9587-bbde5edbb0da tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:24.888775 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e99d00f1-bdc9-406c-9587-bbde5edbb0da tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Going to try to terminate instance {{(pid=118247) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:26:25.232475 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e99d00f1-bdc9-406c-9587-bbde5edbb0da tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 204 len: 0 microversion: 2.1 time: 0.381866 Aug 01 14:26:25.233128 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 345/678] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:26:24 2022] DELETE /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:26:25.241421 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4faf4569-91e3-4c41-b11e-44a33e320dce tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:25.242066 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4faf4569-91e3-4c41-b11e-44a33e320dce tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:25.249588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4faf4569-91e3-4c41-b11e-44a33e320dce tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:25.250072 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4faf4569-91e3-4c41-b11e-44a33e320dce tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:25.250846 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4faf4569-91e3-4c41-b11e-44a33e320dce tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:25.251288 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4faf4569-91e3-4c41-b11e-44a33e320dce tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:25.383157 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4faf4569-91e3-4c41-b11e-44a33e320dce tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:25.390717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4faf4569-91e3-4c41-b11e-44a33e320dce tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.153418 Aug 01 14:26:25.391278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 334/679] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:25 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:26.412103 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a4db766b-fa5a-4b5c-b96e-da33e16fc1e1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:26.412805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a4db766b-fa5a-4b5c-b96e-da33e16fc1e1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:26.419835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a4db766b-fa5a-4b5c-b96e-da33e16fc1e1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:26.425627 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a4db766b-fa5a-4b5c-b96e-da33e16fc1e1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:26.425627 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a4db766b-fa5a-4b5c-b96e-da33e16fc1e1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:26.425627 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a4db766b-fa5a-4b5c-b96e-da33e16fc1e1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:26.552520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a4db766b-fa5a-4b5c-b96e-da33e16fc1e1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:26.559098 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a4db766b-fa5a-4b5c-b96e-da33e16fc1e1 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.151249 Aug 01 14:26:26.559688 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 346/680] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:26 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:26.766803 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b1de88da-09ea-4b57-95f2-8f263a98db7f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-730814261", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2088558392", "security_groups": [{"name": "tempest-secgroup-smoke-1416515599"}], "networks": [{"uuid": "c7d2755e-1c50-498a-9b07-ccd98949e8ea"}], "block_device_mapping_v2": [{"uuid": "a2c64eb1-f0dd-414b-b29a-0d4ab956ce58", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:26.882115 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.network.neutron [None req-b1de88da-09ea-4b57-95f2-8f263a98db7f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] validate_networks() for [('c7d2755e-1c50-498a-9b07-ccd98949e8ea', None, None, None, None, None)] {{(pid=118246) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:26:27.340205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-b1de88da-09ea-4b57-95f2-8f263a98db7f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Flavor limits 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:26:27.340668 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-b1de88da-09ea-4b57-95f2-8f263a98db7f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Image limits 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:26:27.341147 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-b1de88da-09ea-4b57-95f2-8f263a98db7f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Flavor pref 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:26:27.341559 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-b1de88da-09ea-4b57-95f2-8f263a98db7f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Image pref 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:26:27.342086 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-b1de88da-09ea-4b57-95f2-8f263a98db7f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:26:27.350765 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b1de88da-09ea-4b57-95f2-8f263a98db7f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:27.351211 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b1de88da-09ea-4b57-95f2-8f263a98db7f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:27.352012 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b1de88da-09ea-4b57-95f2-8f263a98db7f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:27.352446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b1de88da-09ea-4b57-95f2-8f263a98db7f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:27.369233 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-b1de88da-09ea-4b57-95f2-8f263a98db7f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Getting quotas for project c982cea0e664473ca8df5da87fbe6d73. Resources: {'ram', 'cores', 'instances'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:26:27.373862 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-b1de88da-09ea-4b57-95f2-8f263a98db7f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Getting quotas for user cb2ef56494054dd2ac1c18bee82f2a25 and project c982cea0e664473ca8df5da87fbe6d73. Resources: {'ram', 'cores', 'instances'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:26:27.429828 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b1de88da-09ea-4b57-95f2-8f263a98db7f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Going to run 1 instances... {{(pid=118246) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:26:27.431885 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b1de88da-09ea-4b57-95f2-8f263a98db7f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a2c64eb1-f0dd-414b-b29a-0d4ab956ce58',volume_size=None,volume_type=None)] {{(pid=118246) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:26:27.581015 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c6e167f5-ff27-4ee4-ab98-51642a1075de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:27.581568 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c6e167f5-ff27-4ee4-ab98-51642a1075de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:27.588133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c6e167f5-ff27-4ee4-ab98-51642a1075de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:27.590757 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c6e167f5-ff27-4ee4-ab98-51642a1075de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:27.590757 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c6e167f5-ff27-4ee4-ab98-51642a1075de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:27.590757 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c6e167f5-ff27-4ee4-ab98-51642a1075de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:27.722047 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c6e167f5-ff27-4ee4-ab98-51642a1075de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:27.729525 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c6e167f5-ff27-4ee4-ab98-51642a1075de tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.152448 Aug 01 14:26:27.730130 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 347/681] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:27 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:27.839344 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b1de88da-09ea-4b57-95f2-8f263a98db7f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.077898 Aug 01 14:26:27.839992 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 335/682] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:26:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:26:27.851473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4cd6ea04-8404-4cec-bc8a-56d69ea7f9d1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:27.852123 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-4cd6ea04-8404-4cec-bc8a-56d69ea7f9d1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:27.910827 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4cd6ea04-8404-4cec-bc8a-56d69ea7f9d1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:27.919029 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4cd6ea04-8404-4cec-bc8a-56d69ea7f9d1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1088 microversion: 2.1 time: 0.071304 Aug 01 14:26:27.919899 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 348/683] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:27 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:28.751035 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-2638febe-3c0f-458f-9982-203a900d90e3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:28.751643 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-2638febe-3c0f-458f-9982-203a900d90e3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:28.762472 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2638febe-3c0f-458f-9982-203a900d90e3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:28.762472 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2638febe-3c0f-458f-9982-203a900d90e3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:28.762472 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2638febe-3c0f-458f-9982-203a900d90e3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:28.762472 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2638febe-3c0f-458f-9982-203a900d90e3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:28.901048 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2638febe-3c0f-458f-9982-203a900d90e3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:28.908588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-2638febe-3c0f-458f-9982-203a900d90e3 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1521 microversion: 2.1 time: 0.162007 Aug 01 14:26:28.909161 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 336/684] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:28 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:28.939567 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-69abdb4e-4dae-48e9-8f80-5554a38ba24e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:28.940178 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-69abdb4e-4dae-48e9-8f80-5554a38ba24e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:28.947506 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-69abdb4e-4dae-48e9-8f80-5554a38ba24e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:28.947953 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-69abdb4e-4dae-48e9-8f80-5554a38ba24e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:28.948712 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-69abdb4e-4dae-48e9-8f80-5554a38ba24e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:28.949148 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-69abdb4e-4dae-48e9-8f80-5554a38ba24e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:29.023889 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-69abdb4e-4dae-48e9-8f80-5554a38ba24e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:29.034312 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-69abdb4e-4dae-48e9-8f80-5554a38ba24e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1138 microversion: 2.1 time: 0.098991 Aug 01 14:26:29.035455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 349/685] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:28 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1138 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:29.073535 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-800ce2e3-127f-4e15-97c9-23c422b32ffc req-3a9ad53b-95cd-4cbc-8e5b-819e74e3e804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3824777-d8b1-4993-a19d-921e3054fde8", "name": "network-vif-deleted", "tag": "fb15ef4e-abff-40a5-9a03-acfeb6c36754"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:29.083595 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-800ce2e3-127f-4e15-97c9-23c422b32ffc req-3a9ad53b-95cd-4cbc-8e5b-819e74e3e804 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:29.087638 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-800ce2e3-127f-4e15-97c9-23c422b32ffc req-3a9ad53b-95cd-4cbc-8e5b-819e74e3e804 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:29.095379 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-800ce2e3-127f-4e15-97c9-23c422b32ffc req-3a9ad53b-95cd-4cbc-8e5b-819e74e3e804 service nova] Creating event network-vif-deleted:fb15ef4e-abff-40a5-9a03-acfeb6c36754 for instance c3824777-d8b1-4993-a19d-921e3054fde8 on hv-cinder-78729 Aug 01 14:26:29.100144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-800ce2e3-127f-4e15-97c9-23c422b32ffc req-3a9ad53b-95cd-4cbc-8e5b-819e74e3e804 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030277 Aug 01 14:26:29.100730 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 337/686] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:29.929882 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b8ab17e6-fab3-4cae-9910-cedd5b1e9728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:29.930873 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b8ab17e6-fab3-4cae-9910-cedd5b1e9728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:29.937875 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b8ab17e6-fab3-4cae-9910-cedd5b1e9728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:29.938333 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b8ab17e6-fab3-4cae-9910-cedd5b1e9728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:29.939109 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b8ab17e6-fab3-4cae-9910-cedd5b1e9728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:29.939582 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b8ab17e6-fab3-4cae-9910-cedd5b1e9728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:29.969597 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b8ab17e6-fab3-4cae-9910-cedd5b1e9728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:29.970260 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b8ab17e6-fab3-4cae-9910-cedd5b1e9728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:29.970501 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-b8ab17e6-fab3-4cae-9910-cedd5b1e9728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lazy-loading 'fault' on Instance uuid c3824777-d8b1-4993-a19d-921e3054fde8 {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:26:30.011009 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b8ab17e6-fab3-4cae-9910-cedd5b1e9728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b46ac5a29594c41a83e70838b0a13c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80bd4eb290541d8a713ea5ba60d0de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:30.019178 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b8ab17e6-fab3-4cae-9910-cedd5b1e9728 tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 200 len: 1311 microversion: 2.1 time: 0.093140 Aug 01 14:26:30.019689 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 350/687] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:29 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:30.057604 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f43a4a16-abf5-4404-af14-7b088e47439b tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:30.059131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f43a4a16-abf5-4404-af14-7b088e47439b tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:30.065333 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f43a4a16-abf5-4404-af14-7b088e47439b tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:30.065895 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f43a4a16-abf5-4404-af14-7b088e47439b tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:30.066659 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f43a4a16-abf5-4404-af14-7b088e47439b tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:30.067124 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f43a4a16-abf5-4404-af14-7b088e47439b tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:30.131763 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f43a4a16-abf5-4404-af14-7b088e47439b tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:30.140048 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f43a4a16-abf5-4404-af14-7b088e47439b tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1186 microversion: 2.1 time: 0.087285 Aug 01 14:26:30.140609 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 338/688] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:30 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:31.040909 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ef785d4a-af33-4f9b-82c5-9af3225ef48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:31.041549 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ef785d4a-af33-4f9b-82c5-9af3225ef48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] [instance: c3824777-d8b1-4993-a19d-921e3054fde8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:31.048093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ef785d4a-af33-4f9b-82c5-9af3225ef48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:31.048560 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ef785d4a-af33-4f9b-82c5-9af3225ef48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:31.049344 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ef785d4a-af33-4f9b-82c5-9af3225ef48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:31.049782 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ef785d4a-af33-4f9b-82c5-9af3225ef48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:31.063569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-ef785d4a-af33-4f9b-82c5-9af3225ef48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] HTTP exception thrown: Instance c3824777-d8b1-4993-a19d-921e3054fde8 could not be found. Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ef785d4a-af33-4f9b-82c5-9af3225ef48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Request method failure captured: Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 HTTP/1.1 Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-E4_d12P1yLmeAi6iRzWLrJoqCmtM2x-aOg__n743TyqbmpKOWkckS8c7k87mJ7g9R1SSYLqx8F7V6s4r-ccgea6VgW8gApwCdGP9EruZPZ0fjTAqXY6MSyeImK19uptwGcDBuAzC8kp39QF0SDqE5zKBuWPoWoccfhbA-KPOePrK4 Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: c80bd4eb290541d8a713ea5ba60d0de4 Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1518303562 Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:26:31.065226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:26:31.066743 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c80bd4eb290541d8a713ea5ba60d0de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:26:31.066743 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1518303562 Aug 01 14:26:31.066743 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: c80bd4eb290541d8a713ea5ba60d0de4 Aug 01 14:26:31.066743 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1518303562 Aug 01 14:26:31.066743 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-ServerRescueNegativeTestJSON-1518303562-project Aug 01 14:26:31.066743 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:26:31.066743 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:26:31.066743 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: 6b46ac5a29594c41a83e70838b0a13c8 Aug 01 14:26:31.066743 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1518303562-project Aug 01 14:26:31.066743 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:26:31.066743 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance c3824777-d8b1-4993-a19d-921e3054fde8 could not be found. Aug 01 14:26:31.066743 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': 'c3824777-d8b1-4993-a19d-921e3054fde8'} Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3824777-d8b1-4993-a19d-921e3054fde8 could not be found. Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:26:31.071073 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3824777-d8b1-4993-a19d-921e3054fde8 could not be found. Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3824777-d8b1-4993-a19d-921e3054fde8 could not be found. Aug 01 14:26:31.072518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:31.079187 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ef785d4a-af33-4f9b-82c5-9af3225ef48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] Returning 404 to user: Instance c3824777-d8b1-4993-a19d-921e3054fde8 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:26:31.079187 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ef785d4a-af33-4f9b-82c5-9af3225ef48d tempest-ServerRescueNegativeTestJSON-1518303562 tempest-ServerRescueNegativeTestJSON-1518303562-project] 10.222.0.49 "GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8" status: 404 len: 111 microversion: 2.1 time: 0.029716 Aug 01 14:26:31.079187 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 351/689] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:31 2022] GET /compute/v2.1/servers/c3824777-d8b1-4993-a19d-921e3054fde8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:26:31.164956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-01875610-c29b-4ae6-bb46-6b649bc348ad tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:31.165602 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-01875610-c29b-4ae6-bb46-6b649bc348ad tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:31.172079 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-01875610-c29b-4ae6-bb46-6b649bc348ad tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:31.172612 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-01875610-c29b-4ae6-bb46-6b649bc348ad tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:31.173396 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-01875610-c29b-4ae6-bb46-6b649bc348ad tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:31.173864 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-01875610-c29b-4ae6-bb46-6b649bc348ad tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:31.420968 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-01875610-c29b-4ae6-bb46-6b649bc348ad tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:31.429166 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-01875610-c29b-4ae6-bb46-6b649bc348ad tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1272 microversion: 2.1 time: 0.267871 Aug 01 14:26:31.433907 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 339/690] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:31 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:32.162988 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-c46a27dd-72ae-428a-970f-ef6137dfe599 req-47932394-e4ec-44ba-a009-05587a677554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4551bd54-cfbb-4d79-913e-6380a1e0f5f1", "tag": "2824ee5e-b738-4db9-80e9-f6a993f7e7af"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:32.174470 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-c46a27dd-72ae-428a-970f-ef6137dfe599 req-47932394-e4ec-44ba-a009-05587a677554 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:32.175183 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-c46a27dd-72ae-428a-970f-ef6137dfe599 req-47932394-e4ec-44ba-a009-05587a677554 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:32.187842 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-c46a27dd-72ae-428a-970f-ef6137dfe599 req-47932394-e4ec-44ba-a009-05587a677554 service nova] Creating event network-changed:2824ee5e-b738-4db9-80e9-f6a993f7e7af for instance 4551bd54-cfbb-4d79-913e-6380a1e0f5f1 on hv-cinder-78729 Aug 01 14:26:32.193647 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-c46a27dd-72ae-428a-970f-ef6137dfe599 req-47932394-e4ec-44ba-a009-05587a677554 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035574 Aug 01 14:26:32.194501 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 352/691] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:32.450841 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d92572f8-97a9-4f0b-bb09-94e68ca9744e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:32.451514 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d92572f8-97a9-4f0b-bb09-94e68ca9744e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:32.458854 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d92572f8-97a9-4f0b-bb09-94e68ca9744e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:32.459218 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d92572f8-97a9-4f0b-bb09-94e68ca9744e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:32.460203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d92572f8-97a9-4f0b-bb09-94e68ca9744e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:32.460636 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d92572f8-97a9-4f0b-bb09-94e68ca9744e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:32.483781 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:32.888387 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d92572f8-97a9-4f0b-bb09-94e68ca9744e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:32.897853 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d92572f8-97a9-4f0b-bb09-94e68ca9744e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1260 microversion: 2.1 time: 0.450819 Aug 01 14:26:32.909816 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 340/692] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:32 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1260 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:33.919845 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0b67c02e-0701-417e-964b-05ca3c4cc9ac tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:33.921316 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0b67c02e-0701-417e-964b-05ca3c4cc9ac tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:33.928729 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b67c02e-0701-417e-964b-05ca3c4cc9ac tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:33.929607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b67c02e-0701-417e-964b-05ca3c4cc9ac tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:33.930641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b67c02e-0701-417e-964b-05ca3c4cc9ac tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:33.931244 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b67c02e-0701-417e-964b-05ca3c4cc9ac tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:34.102168 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0b67c02e-0701-417e-964b-05ca3c4cc9ac tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:34.105858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:34.111285 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0b67c02e-0701-417e-964b-05ca3c4cc9ac tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1260 microversion: 2.1 time: 0.195733 Aug 01 14:26:34.111929 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 353/693] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:33 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:35.132499 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e6ece767-2a09-4e77-abac-db693a5ca9cc tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:35.133116 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e6ece767-2a09-4e77-abac-db693a5ca9cc tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:35.140637 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e6ece767-2a09-4e77-abac-db693a5ca9cc tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:35.141092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e6ece767-2a09-4e77-abac-db693a5ca9cc tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:35.141890 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e6ece767-2a09-4e77-abac-db693a5ca9cc tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:35.142337 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e6ece767-2a09-4e77-abac-db693a5ca9cc tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:35.287617 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e6ece767-2a09-4e77-abac-db693a5ca9cc tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:35.295695 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e6ece767-2a09-4e77-abac-db693a5ca9cc tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1260 microversion: 2.1 time: 0.166610 Aug 01 14:26:35.296263 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 341/694] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:35 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:36.318588 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f166d6d2-3bd0-43a8-8b85-8fde155c1c78 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:36.319104 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f166d6d2-3bd0-43a8-8b85-8fde155c1c78 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:36.326273 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f166d6d2-3bd0-43a8-8b85-8fde155c1c78 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:36.327452 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f166d6d2-3bd0-43a8-8b85-8fde155c1c78 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:36.328235 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f166d6d2-3bd0-43a8-8b85-8fde155c1c78 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:36.328744 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f166d6d2-3bd0-43a8-8b85-8fde155c1c78 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:36.462131 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f166d6d2-3bd0-43a8-8b85-8fde155c1c78 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:36.469618 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f166d6d2-3bd0-43a8-8b85-8fde155c1c78 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1260 microversion: 2.1 time: 0.156712 Aug 01 14:26:36.470202 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 354/695] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:36 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:37.084415 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b1f27003-494e-48d4-87b3-275dadb95543 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Action: 'create', calling method: .version_select at 0x7fb24efbd550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-618860189", "metadata": {"Type": "work"}}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b1f27003-494e-48d4-87b3-275dadb95543 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Request method failure captured: Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 121 Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-KcZBRgAVmqqjpa5AOTO6bydox2V2_zojztwszcD40jABDVK_6dU7RpIhM7ISeTFyE_syrJdAnHecWMe0fykgWXO8Nd_IwJKzyDt0awjRIWek_d-QOG2UUSTfgHvXQFMCfcdtOhSqt_mA3Vxh2D7lVrQtlX7HNTCpcgL7IA4vBNj4Y Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: eb1cb4944c984608b88682621cead755 Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:26:37.104146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:26:37.105818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb1cb4944c984608b88682621cead755"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eb1cb4944c984608b88682621cead755"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb1cb4944c984608b88682621cead755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eb1cb4944c984608b88682621cead755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:26:37.105818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.105818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: eb1cb4944c984608b88682621cead755 Aug 01 14:26:37.105818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.105818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-VolumesNegativeTest-492235596-project Aug 01 14:26:37.105818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:26:37.105818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:26:37.105818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: a4f87807459e41f685f4c38724424e6f Aug 01 14:26:37.105818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-VolumesNegativeTest-492235596-project Aug 01 14:26:37.105818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Aug 01 14:26:37.105818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-618860189", "metadata": {"Type": "work"}}} Aug 01 14:26:37.105818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: Aug 01 14:26:37.105818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-618860189', 'metadata': {'Type': 'work'}}}} Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise error Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi '#$%' Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:26:37.106815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 14:26:37.108933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 14:26:37.110128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 14:26:37.110128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.110128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b1f27003-494e-48d4-87b3-275dadb95543 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:26:37.110128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b1f27003-494e-48d4-87b3-275dadb95543 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.133089 Aug 01 14:26:37.110128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 342/696] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Aug 1 14:26:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:26:37.116172 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-17534d39-a9e6-4db8-b784-4f77536fa2e4 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Action: 'create', calling method: .version_select at 0x7fb24f7b6a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1125334531", "metadata": {"Type": "work"}}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-17534d39-a9e6-4db8-b784-4f77536fa2e4 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Request method failure captured: Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 120 Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-KcZBRgAVmqqjpa5AOTO6bydox2V2_zojztwszcD40jABDVK_6dU7RpIhM7ISeTFyE_syrJdAnHecWMe0fykgWXO8Nd_IwJKzyDt0awjRIWek_d-QOG2UUSTfgHvXQFMCfcdtOhSqt_mA3Vxh2D7lVrQtlX7HNTCpcgL7IA4vBNj4Y Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: eb1cb4944c984608b88682621cead755 Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:26:37.121045 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:26:37.122635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb1cb4944c984608b88682621cead755"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eb1cb4944c984608b88682621cead755"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb1cb4944c984608b88682621cead755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eb1cb4944c984608b88682621cead755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:26:37.122635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.122635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: eb1cb4944c984608b88682621cead755 Aug 01 14:26:37.122635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.122635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-VolumesNegativeTest-492235596-project Aug 01 14:26:37.122635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:26:37.122635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:26:37.122635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: a4f87807459e41f685f4c38724424e6f Aug 01 14:26:37.122635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-VolumesNegativeTest-492235596-project Aug 01 14:26:37.122635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Aug 01 14:26:37.122635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1125334531", "metadata": {"Type": "work"}}} Aug 01 14:26:37.122635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: Aug 01 14:26:37.122635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1125334531', 'metadata': {'Type': 'work'}}}} Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise error Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi '0' Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:26:37.124205 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 14:26:37.125491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 14:26:37.126685 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 14:26:37.126685 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.126685 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-17534d39-a9e6-4db8-b784-4f77536fa2e4 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:26:37.126685 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-17534d39-a9e6-4db8-b784-4f77536fa2e4 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010698 Aug 01 14:26:37.126685 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 355/697] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Aug 1 14:26:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:26:37.132923 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b5a908f1-2d9d-4f6c-ad11-91ea474ed8b0 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Action: 'create', calling method: .version_select at 0x7fb254042af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-281210364", "metadata": {"Type": "work"}}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b5a908f1-2d9d-4f6c-ad11-91ea474ed8b0 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Request method failure captured: Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 118 Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-KcZBRgAVmqqjpa5AOTO6bydox2V2_zojztwszcD40jABDVK_6dU7RpIhM7ISeTFyE_syrJdAnHecWMe0fykgWXO8Nd_IwJKzyDt0awjRIWek_d-QOG2UUSTfgHvXQFMCfcdtOhSqt_mA3Vxh2D7lVrQtlX7HNTCpcgL7IA4vBNj4Y Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: eb1cb4944c984608b88682621cead755 Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:26:37.137205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:26:37.138721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb1cb4944c984608b88682621cead755"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eb1cb4944c984608b88682621cead755"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb1cb4944c984608b88682621cead755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eb1cb4944c984608b88682621cead755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:26:37.138721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.138721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: eb1cb4944c984608b88682621cead755 Aug 01 14:26:37.138721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.138721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-VolumesNegativeTest-492235596-project Aug 01 14:26:37.138721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:26:37.138721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:26:37.138721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: a4f87807459e41f685f4c38724424e6f Aug 01 14:26:37.138721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-VolumesNegativeTest-492235596-project Aug 01 14:26:37.138721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Aug 01 14:26:37.138721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-281210364", "metadata": {"Type": "work"}}} Aug 01 14:26:37.138721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: Aug 01 14:26:37.138721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-281210364', 'metadata': {'Type': 'work'}}}} Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise error Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi '' Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:26:37.140203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 14:26:37.141813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 14:26:37.143261 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 14:26:37.143261 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.143261 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b5a908f1-2d9d-4f6c-ad11-91ea474ed8b0 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:26:37.143261 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b5a908f1-2d9d-4f6c-ad11-91ea474ed8b0 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009433 Aug 01 14:26:37.143261 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 343/698] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Aug 1 14:26:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:26:37.148931 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-aa4af37b-fe96-4eaa-817a-e23394dd8f8b tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Calling method '.version_select at 0x7fb24f78ea60>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:37.177585 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-aa4af37b-fe96-4eaa-817a-e23394dd8f8b tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] HTTP exception thrown: Volume tempest-invalid-1496037412 could not be found. Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-aa4af37b-fe96-4eaa-817a-e23394dd8f8b tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Request method failure captured: Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1496037412 HTTP/1.1 Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-KcZBRgAVmqqjpa5AOTO6bydox2V2_zojztwszcD40jABDVK_6dU7RpIhM7ISeTFyE_syrJdAnHecWMe0fykgWXO8Nd_IwJKzyDt0awjRIWek_d-QOG2UUSTfgHvXQFMCfcdtOhSqt_mA3Vxh2D7lVrQtlX7HNTCpcgL7IA4vBNj4Y Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: eb1cb4944c984608b88682621cead755 Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:26:37.179613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:26:37.181135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb1cb4944c984608b88682621cead755"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eb1cb4944c984608b88682621cead755"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb1cb4944c984608b88682621cead755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eb1cb4944c984608b88682621cead755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:26:37.181135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.181135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: eb1cb4944c984608b88682621cead755 Aug 01 14:26:37.181135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.181135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-VolumesNegativeTest-492235596-project Aug 01 14:26:37.181135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:26:37.181135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:26:37.181135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: a4f87807459e41f685f4c38724424e6f Aug 01 14:26:37.181135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-VolumesNegativeTest-492235596-project Aug 01 14:26:37.181135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: Aug 01 14:26:37.181135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Volume tempest-invalid-1496037412 could not be found. Aug 01 14:26:37.181135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': 'tempest-invalid-1496037412'} Aug 01 14:26:37.181135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1496037412 could not be found. (HTTP 404) (Request-ID: req-42ce092e-b137-4d82-bd6a-788d427d4cef) Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:37.182125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:26:37.183455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1496037412 could not be found. Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:26:37.184811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1496037412 could not be found. Aug 01 14:26:37.186761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.186761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:37.186761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.186761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.186761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:37.186761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:37.186761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:26:37.186761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:26:37.186761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1496037412 could not be found. Aug 01 14:26:37.186761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.186761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-aa4af37b-fe96-4eaa-817a-e23394dd8f8b tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Returning 404 to user: Volume tempest-invalid-1496037412 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:26:37.186761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-aa4af37b-fe96-4eaa-817a-e23394dd8f8b tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1496037412" status: 404 len: 99 microversion: 2.1 time: 0.036512 Aug 01 14:26:37.186761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 356/699] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Aug 1 14:26:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1496037412 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 01 14:26:37.191549 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7ef6454e-56d1-4ecf-9d8a-674d4f94acb8 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003707 Aug 01 14:26:37.192059 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 344/700] 10.222.0.49 () {58 vars in 1140 bytes} [Mon Aug 1 14:26:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 14:26:37.200299 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-cf8637fc-e283-4f8a-a331-75c934ebe772 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003663 Aug 01 14:26:37.200780 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 357/701] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Aug 1 14:26:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 14:26:37.209982 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c5cdd96d-111f-483e-93a0-2a625688b3b2 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Calling method '.version_select at 0x7fb24efbd670>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:37.238525 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-c5cdd96d-111f-483e-93a0-2a625688b3b2 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] HTTP exception thrown: Volume 85b1ce8f-bdf8-4fd5-a875-104b4d883275 could not be found. Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c5cdd96d-111f-483e-93a0-2a625688b3b2 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Request method failure captured: Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: DELETE /compute/v2.1/os-volumes/85b1ce8f-bdf8-4fd5-a875-104b4d883275 HTTP/1.1 Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-KcZBRgAVmqqjpa5AOTO6bydox2V2_zojztwszcD40jABDVK_6dU7RpIhM7ISeTFyE_syrJdAnHecWMe0fykgWXO8Nd_IwJKzyDt0awjRIWek_d-QOG2UUSTfgHvXQFMCfcdtOhSqt_mA3Vxh2D7lVrQtlX7HNTCpcgL7IA4vBNj4Y Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: eb1cb4944c984608b88682621cead755 Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:26:37.240588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:26:37.242459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb1cb4944c984608b88682621cead755"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eb1cb4944c984608b88682621cead755"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb1cb4944c984608b88682621cead755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eb1cb4944c984608b88682621cead755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:26:37.242459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.242459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: eb1cb4944c984608b88682621cead755 Aug 01 14:26:37.242459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.242459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-VolumesNegativeTest-492235596-project Aug 01 14:26:37.242459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:26:37.242459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:26:37.242459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: a4f87807459e41f685f4c38724424e6f Aug 01 14:26:37.242459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-VolumesNegativeTest-492235596-project Aug 01 14:26:37.242459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: Aug 01 14:26:37.242459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Volume 85b1ce8f-bdf8-4fd5-a875-104b4d883275 could not be found. Aug 01 14:26:37.242459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': '85b1ce8f-bdf8-4fd5-a875-104b4d883275'} Aug 01 14:26:37.242459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85b1ce8f-bdf8-4fd5-a875-104b4d883275 could not be found. (HTTP 404) (Request-ID: req-b643ba0d-3744-4a78-b708-fb4edeb3d4c2) Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:37.243281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:26:37.244505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85b1ce8f-bdf8-4fd5-a875-104b4d883275 could not be found. Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 14:26:37.246417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:26:37.247705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85b1ce8f-bdf8-4fd5-a875-104b4d883275 could not be found. Aug 01 14:26:37.247705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.247705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:37.247705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.247705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.247705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:37.247705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:37.247705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:26:37.247705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:26:37.247705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85b1ce8f-bdf8-4fd5-a875-104b4d883275 could not be found. Aug 01 14:26:37.247705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.247705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c5cdd96d-111f-483e-93a0-2a625688b3b2 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Returning 404 to user: Volume 85b1ce8f-bdf8-4fd5-a875-104b4d883275 could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:26:37.247705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c5cdd96d-111f-483e-93a0-2a625688b3b2 tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/85b1ce8f-bdf8-4fd5-a875-104b4d883275" status: 404 len: 109 microversion: 2.1 time: 0.035904 Aug 01 14:26:37.247705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 345/702] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Aug 1 14:26:37 2022] DELETE /compute/v2.1/os-volumes/85b1ce8f-bdf8-4fd5-a875-104b4d883275 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:26:37.252559 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ffc771e2-7752-4f58-87e3-bd1c2b9d7b8f tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Calling method '.version_select at 0x7fb24f7b6ee0>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:37.279881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-ffc771e2-7752-4f58-87e3-bd1c2b9d7b8f tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] HTTP exception thrown: Volume 54163f8a-768a-4907-8088-683c9bd1efb0 could not be found. Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ffc771e2-7752-4f58-87e3-bd1c2b9d7b8f tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Request method failure captured: Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/os-volumes/54163f8a-768a-4907-8088-683c9bd1efb0 HTTP/1.1 Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-KcZBRgAVmqqjpa5AOTO6bydox2V2_zojztwszcD40jABDVK_6dU7RpIhM7ISeTFyE_syrJdAnHecWMe0fykgWXO8Nd_IwJKzyDt0awjRIWek_d-QOG2UUSTfgHvXQFMCfcdtOhSqt_mA3Vxh2D7lVrQtlX7HNTCpcgL7IA4vBNj4Y Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: eb1cb4944c984608b88682621cead755 Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:26:37.281837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:26:37.283377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb1cb4944c984608b88682621cead755"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eb1cb4944c984608b88682621cead755"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eb1cb4944c984608b88682621cead755"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eb1cb4944c984608b88682621cead755"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:26:37.283377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.283377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: eb1cb4944c984608b88682621cead755 Aug 01 14:26:37.283377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-VolumesNegativeTest-492235596 Aug 01 14:26:37.283377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-VolumesNegativeTest-492235596-project Aug 01 14:26:37.283377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:26:37.283377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:26:37.283377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: a4f87807459e41f685f4c38724424e6f Aug 01 14:26:37.283377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-VolumesNegativeTest-492235596-project Aug 01 14:26:37.283377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: Aug 01 14:26:37.283377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Volume 54163f8a-768a-4907-8088-683c9bd1efb0 could not be found. Aug 01 14:26:37.283377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '54163f8a-768a-4907-8088-683c9bd1efb0'} Aug 01 14:26:37.283377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 54163f8a-768a-4907-8088-683c9bd1efb0 could not be found. (HTTP 404) (Request-ID: req-42bb0984-c6ec-4d7d-9ef6-669d587543a6) Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:37.284251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:26:37.285536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 54163f8a-768a-4907-8088-683c9bd1efb0 could not be found. Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 14:26:37.286702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:26:37.287937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 54163f8a-768a-4907-8088-683c9bd1efb0 could not be found. Aug 01 14:26:37.287937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.287937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:26:37.287937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.287937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:26:37.287937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:26:37.287937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:26:37.287937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:26:37.287937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:26:37.287937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 54163f8a-768a-4907-8088-683c9bd1efb0 could not be found. Aug 01 14:26:37.287937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:26:37.287937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ffc771e2-7752-4f58-87e3-bd1c2b9d7b8f tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] Returning 404 to user: Volume 54163f8a-768a-4907-8088-683c9bd1efb0 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:26:37.287937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ffc771e2-7752-4f58-87e3-bd1c2b9d7b8f tempest-VolumesNegativeTest-492235596 tempest-VolumesNegativeTest-492235596-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/54163f8a-768a-4907-8088-683c9bd1efb0" status: 404 len: 109 microversion: 2.1 time: 0.035154 Aug 01 14:26:37.287937 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 358/703] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Aug 1 14:26:37 2022] GET /compute/v2.1/os-volumes/54163f8a-768a-4907-8088-683c9bd1efb0 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:26:37.487876 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=2 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:37.488691 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=6 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:37.493362 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0c55d6dd-17aa-4ad1-8f08-f16654c178fa tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:37.494009 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0c55d6dd-17aa-4ad1-8f08-f16654c178fa tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:37.500878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0c55d6dd-17aa-4ad1-8f08-f16654c178fa tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:37.501326 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0c55d6dd-17aa-4ad1-8f08-f16654c178fa tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:37.502122 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0c55d6dd-17aa-4ad1-8f08-f16654c178fa tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:37.502557 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0c55d6dd-17aa-4ad1-8f08-f16654c178fa tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:37.637465 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-0c55d6dd-17aa-4ad1-8f08-f16654c178fa tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:37.645614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0c55d6dd-17aa-4ad1-8f08-f16654c178fa tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1260 microversion: 2.1 time: 0.158612 Aug 01 14:26:37.648050 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 346/704] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:37 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:38.669239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=2 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:38.673460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3355488f-c6a9-4797-9b72-64adc228bb96 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:38.674093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3355488f-c6a9-4797-9b72-64adc228bb96 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:38.680124 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3355488f-c6a9-4797-9b72-64adc228bb96 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:38.681826 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3355488f-c6a9-4797-9b72-64adc228bb96 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:38.681826 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3355488f-c6a9-4797-9b72-64adc228bb96 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:38.682149 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3355488f-c6a9-4797-9b72-64adc228bb96 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:38.818178 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3355488f-c6a9-4797-9b72-64adc228bb96 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:38.825804 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3355488f-c6a9-4797-9b72-64adc228bb96 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1260 microversion: 2.1 time: 0.160540 Aug 01 14:26:38.827055 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 359/705] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:38 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:39.847500 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-41af6556-915d-45fa-ae36-b880fcdd9ab7 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:39.848185 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-41af6556-915d-45fa-ae36-b880fcdd9ab7 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:39.855039 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-41af6556-915d-45fa-ae36-b880fcdd9ab7 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:39.855497 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-41af6556-915d-45fa-ae36-b880fcdd9ab7 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:39.856308 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-41af6556-915d-45fa-ae36-b880fcdd9ab7 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:39.856752 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-41af6556-915d-45fa-ae36-b880fcdd9ab7 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:39.997399 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-41af6556-915d-45fa-ae36-b880fcdd9ab7 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:40.005715 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-41af6556-915d-45fa-ae36-b880fcdd9ab7 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1260 microversion: 2.1 time: 0.162405 Aug 01 14:26:40.006311 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 347/706] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:39 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:41.026588 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-75bfee2e-547e-4692-9352-ac4d4a7ba06c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:41.027197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-75bfee2e-547e-4692-9352-ac4d4a7ba06c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:41.033716 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-75bfee2e-547e-4692-9352-ac4d4a7ba06c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:41.034194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-75bfee2e-547e-4692-9352-ac4d4a7ba06c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:41.034953 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-75bfee2e-547e-4692-9352-ac4d4a7ba06c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:41.035389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-75bfee2e-547e-4692-9352-ac4d4a7ba06c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:41.211917 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-75bfee2e-547e-4692-9352-ac4d4a7ba06c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:41.220077 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-75bfee2e-547e-4692-9352-ac4d4a7ba06c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1260 microversion: 2.1 time: 0.197328 Aug 01 14:26:41.220653 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 360/707] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:41 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:42.241903 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b3f1e4c1-be4c-44db-9663-848a88c15539 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:42.242521 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b3f1e4c1-be4c-44db-9663-848a88c15539 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:42.249144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b3f1e4c1-be4c-44db-9663-848a88c15539 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:42.249602 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b3f1e4c1-be4c-44db-9663-848a88c15539 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:42.250414 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b3f1e4c1-be4c-44db-9663-848a88c15539 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:42.250856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b3f1e4c1-be4c-44db-9663-848a88c15539 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:42.391453 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-b3f1e4c1-be4c-44db-9663-848a88c15539 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:42.412724 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b3f1e4c1-be4c-44db-9663-848a88c15539 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1260 microversion: 2.1 time: 0.175795 Aug 01 14:26:42.414095 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 348/708] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:42 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:43.434074 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-eb896f15-2d4f-440f-8721-422129e51cb1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:43.434835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-eb896f15-2d4f-440f-8721-422129e51cb1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:43.438558 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:43.443393 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-eb896f15-2d4f-440f-8721-422129e51cb1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:43.443853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-eb896f15-2d4f-440f-8721-422129e51cb1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:43.444902 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-eb896f15-2d4f-440f-8721-422129e51cb1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:43.445170 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-eb896f15-2d4f-440f-8721-422129e51cb1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:43.581257 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-eb896f15-2d4f-440f-8721-422129e51cb1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:43.588958 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-eb896f15-2d4f-440f-8721-422129e51cb1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1260 microversion: 2.1 time: 0.159105 Aug 01 14:26:43.589571 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 361/709] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:43 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:44.262607 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-cd1da459-640f-4356-93cc-6a6bbe3c2c36 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:44.263149 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-cd1da459-640f-4356-93cc-6a6bbe3c2c36 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:44.270110 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cd1da459-640f-4356-93cc-6a6bbe3c2c36 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:44.270563 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cd1da459-640f-4356-93cc-6a6bbe3c2c36 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:44.271435 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cd1da459-640f-4356-93cc-6a6bbe3c2c36 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:44.271848 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cd1da459-640f-4356-93cc-6a6bbe3c2c36 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:44.297243 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-cd1da459-640f-4356-93cc-6a6bbe3c2c36 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82/ips" status: 200 len: 152 microversion: 2.20 time: 0.038522 Aug 01 14:26:44.297955 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 349/710] 10.222.0.49 () {60 vars in 1289 bytes} [Mon Aug 1 14:26:44 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:26:44.475218 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-5b1ba9c8-4681-4d59-9d28-998033c35562 req-abc5abf0-46de-4735-8c4e-639080fae485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4551bd54-cfbb-4d79-913e-6380a1e0f5f1", "name": "network-vif-plugged", "status": "completed", "tag": "2824ee5e-b738-4db9-80e9-f6a993f7e7af"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:44.485609 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-5b1ba9c8-4681-4d59-9d28-998033c35562 req-abc5abf0-46de-4735-8c4e-639080fae485 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:44.486097 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-5b1ba9c8-4681-4d59-9d28-998033c35562 req-abc5abf0-46de-4735-8c4e-639080fae485 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:44.497272 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-5b1ba9c8-4681-4d59-9d28-998033c35562 req-abc5abf0-46de-4735-8c4e-639080fae485 service nova] Creating event network-vif-plugged:2824ee5e-b738-4db9-80e9-f6a993f7e7af for instance 4551bd54-cfbb-4d79-913e-6380a1e0f5f1 on hv-cinder-78729 Aug 01 14:26:44.502610 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-5b1ba9c8-4681-4d59-9d28-998033c35562 req-abc5abf0-46de-4735-8c4e-639080fae485 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181606 Aug 01 14:26:44.503184 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 362/711] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:44.610920 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7689013e-d71b-4940-ba2e-4b14aef476ba tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:44.611529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7689013e-d71b-4940-ba2e-4b14aef476ba tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:44.620122 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7689013e-d71b-4940-ba2e-4b14aef476ba tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:44.620122 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7689013e-d71b-4940-ba2e-4b14aef476ba tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:44.620122 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7689013e-d71b-4940-ba2e-4b14aef476ba tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:44.620122 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7689013e-d71b-4940-ba2e-4b14aef476ba tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:44.758739 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7689013e-d71b-4940-ba2e-4b14aef476ba tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:44.770002 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7689013e-d71b-4940-ba2e-4b14aef476ba tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1260 microversion: 2.1 time: 0.163852 Aug 01 14:26:44.770586 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 350/712] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:44 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:45.792620 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-2ab0223a-4791-466b-bfa4-c9828f92a51d tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:45.793486 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-2ab0223a-4791-466b-bfa4-c9828f92a51d tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:45.801826 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2ab0223a-4791-466b-bfa4-c9828f92a51d tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:45.802400 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2ab0223a-4791-466b-bfa4-c9828f92a51d tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:45.803174 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2ab0223a-4791-466b-bfa4-c9828f92a51d tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:45.803611 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2ab0223a-4791-466b-bfa4-c9828f92a51d tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:45.942360 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2ab0223a-4791-466b-bfa4-c9828f92a51d tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:45.950070 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-2ab0223a-4791-466b-bfa4-c9828f92a51d tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1260 microversion: 2.1 time: 0.162271 Aug 01 14:26:45.950649 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 363/713] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:45 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:26:46.649182 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-02cba50c-fe09-439b-9dab-9ad3a9969458 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:46.649846 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-02cba50c-fe09-439b-9dab-9ad3a9969458 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:46.656459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-02cba50c-fe09-439b-9dab-9ad3a9969458 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:46.656918 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-02cba50c-fe09-439b-9dab-9ad3a9969458 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:46.657778 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-02cba50c-fe09-439b-9dab-9ad3a9969458 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:46.658256 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-02cba50c-fe09-439b-9dab-9ad3a9969458 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:46.680923 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-02cba50c-fe09-439b-9dab-9ad3a9969458 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lazy-loading 'flavor' on Instance uuid 015b4877-f47b-4e45-a2b8-e36ba4bacf82 {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:26:46.972272 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-bbadbea6-3a77-4318-9ba5-6f55ee73d9f5 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:46.972812 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-bbadbea6-3a77-4318-9ba5-6f55ee73d9f5 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:46.979429 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bbadbea6-3a77-4318-9ba5-6f55ee73d9f5 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:46.980034 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bbadbea6-3a77-4318-9ba5-6f55ee73d9f5 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:46.980801 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bbadbea6-3a77-4318-9ba5-6f55ee73d9f5 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:46.981272 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bbadbea6-3a77-4318-9ba5-6f55ee73d9f5 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:47.129106 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bbadbea6-3a77-4318-9ba5-6f55ee73d9f5 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:47.136830 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-bbadbea6-3a77-4318-9ba5-6f55ee73d9f5 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1443 microversion: 2.1 time: 0.168718 Aug 01 14:26:47.137486 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 364/714] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:46 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1443 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:47.158390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6348a254-eaf7-4b89-8419-18a63a088287 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:47.159001 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-6348a254-eaf7-4b89-8419-18a63a088287 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:47.164996 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6348a254-eaf7-4b89-8419-18a63a088287 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:47.165491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6348a254-eaf7-4b89-8419-18a63a088287 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:47.166456 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6348a254-eaf7-4b89-8419-18a63a088287 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:47.167071 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6348a254-eaf7-4b89-8419-18a63a088287 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:47.204714 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-02cba50c-fe09-439b-9dab-9ad3a9969458 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "POST /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82/action" status: 202 len: 0 microversion: 2.20 time: 0.559329 Aug 01 14:26:47.205310 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 351/715] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Aug 1 14:26:46 2022] POST /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:26:47.214839 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f6ad3ece-76e7-491c-8ca8-7846ffd8ca90 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:47.215693 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f6ad3ece-76e7-491c-8ca8-7846ffd8ca90 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:47.218969 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:47.224281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f6ad3ece-76e7-491c-8ca8-7846ffd8ca90 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:47.224662 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f6ad3ece-76e7-491c-8ca8-7846ffd8ca90 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:47.225433 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f6ad3ece-76e7-491c-8ca8-7846ffd8ca90 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:47.225897 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f6ad3ece-76e7-491c-8ca8-7846ffd8ca90 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:47.350726 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6348a254-eaf7-4b89-8419-18a63a088287 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:47.358512 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-6348a254-eaf7-4b89-8419-18a63a088287 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1443 microversion: 2.1 time: 0.204992 Aug 01 14:26:47.359178 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 365/716] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:26:47 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1443 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:26:47.395793 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f6ad3ece-76e7-491c-8ca8-7846ffd8ca90 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:47.404604 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f6ad3ece-76e7-491c-8ca8-7846ffd8ca90 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:47.406133 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f6ad3ece-76e7-491c-8ca8-7846ffd8ca90 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:47.412384 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f6ad3ece-76e7-491c-8ca8-7846ffd8ca90 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.201906 Aug 01 14:26:47.413227 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 352/717] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:47 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:26:48.436225 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d4af33b7-f417-4711-95ca-8c51a08301bf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:48.436872 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d4af33b7-f417-4711-95ca-8c51a08301bf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:48.443462 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d4af33b7-f417-4711-95ca-8c51a08301bf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:48.444277 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d4af33b7-f417-4711-95ca-8c51a08301bf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:48.445041 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d4af33b7-f417-4711-95ca-8c51a08301bf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:48.445477 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d4af33b7-f417-4711-95ca-8c51a08301bf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:48.606729 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d4af33b7-f417-4711-95ca-8c51a08301bf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:48.614882 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d4af33b7-f417-4711-95ca-8c51a08301bf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:48.616933 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d4af33b7-f417-4711-95ca-8c51a08301bf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:48.618332 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d4af33b7-f417-4711-95ca-8c51a08301bf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.186649 Aug 01 14:26:48.620920 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 366/718] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:48 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:49.642714 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4b66523b-c200-4047-98ad-43c12293673f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:49.643467 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4b66523b-c200-4047-98ad-43c12293673f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:49.650492 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4b66523b-c200-4047-98ad-43c12293673f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:49.651042 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4b66523b-c200-4047-98ad-43c12293673f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:49.651949 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4b66523b-c200-4047-98ad-43c12293673f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:49.652470 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4b66523b-c200-4047-98ad-43c12293673f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:49.813155 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4b66523b-c200-4047-98ad-43c12293673f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:49.822793 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4b66523b-c200-4047-98ad-43c12293673f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:49.824989 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4b66523b-c200-4047-98ad-43c12293673f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:49.826295 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4b66523b-c200-4047-98ad-43c12293673f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.188191 Aug 01 14:26:49.831325 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 353/719] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:49 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:49.914389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-a9b1d235-29d3-4a0f-bc76-09a236fef4e1 req-cce2025c-8ddd-44f7-a7d2-71b6bce2670a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4551bd54-cfbb-4d79-913e-6380a1e0f5f1", "tag": "2824ee5e-b738-4db9-80e9-f6a993f7e7af"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:26:49.925145 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-a9b1d235-29d3-4a0f-bc76-09a236fef4e1 req-cce2025c-8ddd-44f7-a7d2-71b6bce2670a service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:49.928110 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-a9b1d235-29d3-4a0f-bc76-09a236fef4e1 req-cce2025c-8ddd-44f7-a7d2-71b6bce2670a service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:49.936878 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-a9b1d235-29d3-4a0f-bc76-09a236fef4e1 req-cce2025c-8ddd-44f7-a7d2-71b6bce2670a service nova] Creating event network-changed:2824ee5e-b738-4db9-80e9-f6a993f7e7af for instance 4551bd54-cfbb-4d79-913e-6380a1e0f5f1 on hv-cinder-78729 Aug 01 14:26:49.941847 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-a9b1d235-29d3-4a0f-bc76-09a236fef4e1 req-cce2025c-8ddd-44f7-a7d2-71b6bce2670a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031034 Aug 01 14:26:49.942815 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 367/720] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:26:50.848815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-91d2c986-e614-49e0-8e98-f20b7c69740c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:50.850157 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-91d2c986-e614-49e0-8e98-f20b7c69740c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:50.856616 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-91d2c986-e614-49e0-8e98-f20b7c69740c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:50.857073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-91d2c986-e614-49e0-8e98-f20b7c69740c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:50.858405 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-91d2c986-e614-49e0-8e98-f20b7c69740c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:50.859269 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-91d2c986-e614-49e0-8e98-f20b7c69740c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:51.014014 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-91d2c986-e614-49e0-8e98-f20b7c69740c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:51.021906 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-91d2c986-e614-49e0-8e98-f20b7c69740c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:51.023414 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-91d2c986-e614-49e0-8e98-f20b7c69740c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:51.024568 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-91d2c986-e614-49e0-8e98-f20b7c69740c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.179585 Aug 01 14:26:51.025141 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 354/721] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:50 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:52.049487 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-72301aae-3abb-427e-83c4-17ebdff30966 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:52.050213 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-72301aae-3abb-427e-83c4-17ebdff30966 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:52.056507 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-72301aae-3abb-427e-83c4-17ebdff30966 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:52.056959 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-72301aae-3abb-427e-83c4-17ebdff30966 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:52.061053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-72301aae-3abb-427e-83c4-17ebdff30966 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:52.061053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-72301aae-3abb-427e-83c4-17ebdff30966 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:52.186969 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-72301aae-3abb-427e-83c4-17ebdff30966 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:52.195014 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-72301aae-3abb-427e-83c4-17ebdff30966 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:52.196444 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-72301aae-3abb-427e-83c4-17ebdff30966 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:52.197596 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-72301aae-3abb-427e-83c4-17ebdff30966 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.153491 Aug 01 14:26:52.198182 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 368/722] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:52 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:53.221991 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-218551bd-0980-455a-a9f0-8a0793248f27 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:53.222610 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-218551bd-0980-455a-a9f0-8a0793248f27 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:53.229165 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-218551bd-0980-455a-a9f0-8a0793248f27 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:53.229615 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-218551bd-0980-455a-a9f0-8a0793248f27 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:53.230407 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-218551bd-0980-455a-a9f0-8a0793248f27 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:53.230847 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-218551bd-0980-455a-a9f0-8a0793248f27 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:53.360246 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-218551bd-0980-455a-a9f0-8a0793248f27 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:53.368450 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-218551bd-0980-455a-a9f0-8a0793248f27 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:53.370998 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-218551bd-0980-455a-a9f0-8a0793248f27 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:53.371116 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-218551bd-0980-455a-a9f0-8a0793248f27 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.154119 Aug 01 14:26:53.371652 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 355/723] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:53 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:54.394108 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ef32c3cd-db85-4c86-9127-946ed5651e72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:54.394822 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ef32c3cd-db85-4c86-9127-946ed5651e72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:54.401162 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ef32c3cd-db85-4c86-9127-946ed5651e72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:54.401620 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ef32c3cd-db85-4c86-9127-946ed5651e72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:54.402434 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ef32c3cd-db85-4c86-9127-946ed5651e72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:54.402882 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ef32c3cd-db85-4c86-9127-946ed5651e72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:54.538534 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ef32c3cd-db85-4c86-9127-946ed5651e72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:54.546811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ef32c3cd-db85-4c86-9127-946ed5651e72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:54.548318 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ef32c3cd-db85-4c86-9127-946ed5651e72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:54.549492 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ef32c3cd-db85-4c86-9127-946ed5651e72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.159383 Aug 01 14:26:54.550093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 369/724] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:54 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:55.572523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f2481f87-7fdd-42c7-a8fd-d9cc00a67b41 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:55.573139 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f2481f87-7fdd-42c7-a8fd-d9cc00a67b41 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:55.580272 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2481f87-7fdd-42c7-a8fd-d9cc00a67b41 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:55.580716 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2481f87-7fdd-42c7-a8fd-d9cc00a67b41 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:55.581778 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2481f87-7fdd-42c7-a8fd-d9cc00a67b41 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:55.582245 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2481f87-7fdd-42c7-a8fd-d9cc00a67b41 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:55.711181 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f2481f87-7fdd-42c7-a8fd-d9cc00a67b41 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:55.718936 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f2481f87-7fdd-42c7-a8fd-d9cc00a67b41 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:55.720459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f2481f87-7fdd-42c7-a8fd-d9cc00a67b41 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:55.721640 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f2481f87-7fdd-42c7-a8fd-d9cc00a67b41 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.153073 Aug 01 14:26:55.722242 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 356/725] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:55 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:56.744830 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-02e161d9-a40b-418a-8114-36fb3109b618 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:56.745439 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-02e161d9-a40b-418a-8114-36fb3109b618 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:56.752968 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-02e161d9-a40b-418a-8114-36fb3109b618 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:56.753409 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-02e161d9-a40b-418a-8114-36fb3109b618 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:56.754199 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-02e161d9-a40b-418a-8114-36fb3109b618 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:56.754634 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-02e161d9-a40b-418a-8114-36fb3109b618 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:56.893141 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-02e161d9-a40b-418a-8114-36fb3109b618 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:56.901020 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-02e161d9-a40b-418a-8114-36fb3109b618 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:56.903096 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-02e161d9-a40b-418a-8114-36fb3109b618 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:56.903796 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-02e161d9-a40b-418a-8114-36fb3109b618 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.163217 Aug 01 14:26:56.904721 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 370/726] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:56 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:57.930315 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d5c10529-f843-4220-99d2-906ebad6d274 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:57.931518 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d5c10529-f843-4220-99d2-906ebad6d274 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:57.939182 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d5c10529-f843-4220-99d2-906ebad6d274 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:57.939640 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d5c10529-f843-4220-99d2-906ebad6d274 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:57.940410 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d5c10529-f843-4220-99d2-906ebad6d274 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:57.940844 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d5c10529-f843-4220-99d2-906ebad6d274 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:58.073245 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d5c10529-f843-4220-99d2-906ebad6d274 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:58.081794 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d5c10529-f843-4220-99d2-906ebad6d274 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:58.083320 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d5c10529-f843-4220-99d2-906ebad6d274 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:58.084500 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d5c10529-f843-4220-99d2-906ebad6d274 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.160058 Aug 01 14:26:58.085061 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 357/727] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:57 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:26:59.107604 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c8aa70e0-151d-45e0-9f1f-0a256ee38fba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:26:59.108992 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c8aa70e0-151d-45e0-9f1f-0a256ee38fba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:26:59.114796 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c8aa70e0-151d-45e0-9f1f-0a256ee38fba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:59.115255 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c8aa70e0-151d-45e0-9f1f-0a256ee38fba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:59.116384 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c8aa70e0-151d-45e0-9f1f-0a256ee38fba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:26:59.116722 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c8aa70e0-151d-45e0-9f1f-0a256ee38fba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:26:59.245737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c8aa70e0-151d-45e0-9f1f-0a256ee38fba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:59.253687 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c8aa70e0-151d-45e0-9f1f-0a256ee38fba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:59.255225 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c8aa70e0-151d-45e0-9f1f-0a256ee38fba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:26:59.256354 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c8aa70e0-151d-45e0-9f1f-0a256ee38fba tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.153079 Aug 01 14:26:59.256914 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 371/728] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:26:59 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:00.279917 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-29d2b850-0029-4835-9609-ff6addb90188 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:00.280556 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-29d2b850-0029-4835-9609-ff6addb90188 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:00.286755 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-29d2b850-0029-4835-9609-ff6addb90188 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:00.287210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-29d2b850-0029-4835-9609-ff6addb90188 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:00.288008 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-29d2b850-0029-4835-9609-ff6addb90188 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:00.288443 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-29d2b850-0029-4835-9609-ff6addb90188 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:00.415945 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-29d2b850-0029-4835-9609-ff6addb90188 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:00.424543 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-29d2b850-0029-4835-9609-ff6addb90188 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:00.446023 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-29d2b850-0029-4835-9609-ff6addb90188 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:00.446023 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-29d2b850-0029-4835-9609-ff6addb90188 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.151515 Aug 01 14:27:00.446023 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 358/729] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:00 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:01.455124 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c5e0c118-f73b-4c7a-aea7-ff0b8fdc5480 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:01.455931 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c5e0c118-f73b-4c7a-aea7-ff0b8fdc5480 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:01.462306 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c5e0c118-f73b-4c7a-aea7-ff0b8fdc5480 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:01.462755 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c5e0c118-f73b-4c7a-aea7-ff0b8fdc5480 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:01.463520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c5e0c118-f73b-4c7a-aea7-ff0b8fdc5480 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:01.463962 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c5e0c118-f73b-4c7a-aea7-ff0b8fdc5480 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:01.599405 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c5e0c118-f73b-4c7a-aea7-ff0b8fdc5480 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:01.607654 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c5e0c118-f73b-4c7a-aea7-ff0b8fdc5480 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:01.609333 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c5e0c118-f73b-4c7a-aea7-ff0b8fdc5480 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:01.610530 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c5e0c118-f73b-4c7a-aea7-ff0b8fdc5480 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.159953 Aug 01 14:27:01.611089 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 372/730] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:01 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:02.022076 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0564b02d-c6fc-4033-974a-0842209b1f78 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:02.022563 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0564b02d-c6fc-4033-974a-0842209b1f78 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:02.029251 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0564b02d-c6fc-4033-974a-0842209b1f78 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:02.029715 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0564b02d-c6fc-4033-974a-0842209b1f78 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:02.030522 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0564b02d-c6fc-4033-974a-0842209b1f78 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:02.030968 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0564b02d-c6fc-4033-974a-0842209b1f78 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:02.047922 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:02.054480 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0564b02d-c6fc-4033-974a-0842209b1f78 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/ips" status: 200 len: 147 microversion: 2.1 time: 0.036184 Aug 01 14:27:02.055055 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 359/731] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Aug 1 14:27:02 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:02.634536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ab392238-00bc-420c-b644-390a085ed6fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:02.635150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ab392238-00bc-420c-b644-390a085ed6fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:02.642093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ab392238-00bc-420c-b644-390a085ed6fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:02.642551 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ab392238-00bc-420c-b644-390a085ed6fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:02.643324 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ab392238-00bc-420c-b644-390a085ed6fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:02.643765 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ab392238-00bc-420c-b644-390a085ed6fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:02.776030 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ab392238-00bc-420c-b644-390a085ed6fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:02.784850 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ab392238-00bc-420c-b644-390a085ed6fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:02.786442 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ab392238-00bc-420c-b644-390a085ed6fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:02.787607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ab392238-00bc-420c-b644-390a085ed6fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.157076 Aug 01 14:27:02.788157 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 373/732] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:02 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:03.709341 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7a127031-1f9a-425f-928a-6b05cd5a5402 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e2eaa3d-debd-4616-9933-2deb18f54b37"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:03.715637 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7a127031-1f9a-425f-928a-6b05cd5a5402 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:03.719277 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7a127031-1f9a-425f-928a-6b05cd5a5402 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:03.721084 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7a127031-1f9a-425f-928a-6b05cd5a5402 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:03.721084 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7a127031-1f9a-425f-928a-6b05cd5a5402 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:03.721084 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7a127031-1f9a-425f-928a-6b05cd5a5402 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:03.812702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-577ed029-99e2-485b-9c90-15af3fcd3621 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:03.813313 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-577ed029-99e2-485b-9c90-15af3fcd3621 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:03.819875 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-577ed029-99e2-485b-9c90-15af3fcd3621 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:03.820323 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-577ed029-99e2-485b-9c90-15af3fcd3621 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:03.821147 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-577ed029-99e2-485b-9c90-15af3fcd3621 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:03.821598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-577ed029-99e2-485b-9c90-15af3fcd3621 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:03.957861 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-577ed029-99e2-485b-9c90-15af3fcd3621 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:03.965788 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-577ed029-99e2-485b-9c90-15af3fcd3621 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:03.968172 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-577ed029-99e2-485b-9c90-15af3fcd3621 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:03.970350 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-577ed029-99e2-485b-9c90-15af3fcd3621 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1745 microversion: 2.20 time: 0.161515 Aug 01 14:27:03.971343 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 374/733] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:03 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:27:04.521447 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7a127031-1f9a-425f-928a-6b05cd5a5402 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "POST /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.815806 Aug 01 14:27:04.522087 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 360/734] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Aug 1 14:27:03 2022] POST /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments => generated 194 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:04.996030 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-cfa846c8-8b49-4706-812e-391e6f096a9d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:04.996629 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-cfa846c8-8b49-4706-812e-391e6f096a9d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:05.003884 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cfa846c8-8b49-4706-812e-391e6f096a9d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:05.004372 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cfa846c8-8b49-4706-812e-391e6f096a9d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:05.005159 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cfa846c8-8b49-4706-812e-391e6f096a9d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:05.005618 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cfa846c8-8b49-4706-812e-391e6f096a9d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:05.134348 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-cfa846c8-8b49-4706-812e-391e6f096a9d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:05.138110 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=100 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:05.143630 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-cfa846c8-8b49-4706-812e-391e6f096a9d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:05.145125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-cfa846c8-8b49-4706-812e-391e6f096a9d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:05.147257 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-cfa846c8-8b49-4706-812e-391e6f096a9d tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1745 microversion: 2.20 time: 0.154389 Aug 01 14:27:05.147257 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 375/735] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:04 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:06.176505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-6da67345-f5ea-42b5-b328-2f035e02fa23 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:06.180945 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-6da67345-f5ea-42b5-b328-2f035e02fa23 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:06.209999 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6da67345-f5ea-42b5-b328-2f035e02fa23 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:06.210499 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6da67345-f5ea-42b5-b328-2f035e02fa23 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:06.211297 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6da67345-f5ea-42b5-b328-2f035e02fa23 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:06.211736 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6da67345-f5ea-42b5-b328-2f035e02fa23 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:06.408115 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-6da67345-f5ea-42b5-b328-2f035e02fa23 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:06.417939 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-6da67345-f5ea-42b5-b328-2f035e02fa23 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:06.420407 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-6da67345-f5ea-42b5-b328-2f035e02fa23 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:06.422347 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-6da67345-f5ea-42b5-b328-2f035e02fa23 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1740 microversion: 2.20 time: 0.254475 Aug 01 14:27:06.423184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 361/736] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:06 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:07.447865 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7385c77f-ed0a-41c2-b053-79717a6038b8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:07.452800 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7385c77f-ed0a-41c2-b053-79717a6038b8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:07.456842 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7385c77f-ed0a-41c2-b053-79717a6038b8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:07.457303 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7385c77f-ed0a-41c2-b053-79717a6038b8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:07.458152 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7385c77f-ed0a-41c2-b053-79717a6038b8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:07.458766 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7385c77f-ed0a-41c2-b053-79717a6038b8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:07.624859 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7385c77f-ed0a-41c2-b053-79717a6038b8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:07.634329 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7385c77f-ed0a-41c2-b053-79717a6038b8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:07.636528 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7385c77f-ed0a-41c2-b053-79717a6038b8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:07.636996 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7385c77f-ed0a-41c2-b053-79717a6038b8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1740 microversion: 2.20 time: 0.193013 Aug 01 14:27:07.637581 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 376/737] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:07 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:08.381453 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-affe7f93-5cc7-487d-b5a6-61245035be2b req-32f9c691-da57-4539-9839-22d45d4dd201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015b4877-f47b-4e45-a2b8-e36ba4bacf82", "name": "network-vif-plugged", "status": "completed", "tag": "09014052-8b79-46d5-99ce-d8c6b6ccd445"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:08.397096 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-affe7f93-5cc7-487d-b5a6-61245035be2b req-32f9c691-da57-4539-9839-22d45d4dd201 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:08.397802 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-affe7f93-5cc7-487d-b5a6-61245035be2b req-32f9c691-da57-4539-9839-22d45d4dd201 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:08.416782 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-affe7f93-5cc7-487d-b5a6-61245035be2b req-32f9c691-da57-4539-9839-22d45d4dd201 service nova] Creating event network-vif-plugged:09014052-8b79-46d5-99ce-d8c6b6ccd445 for instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 on hv-cinder-78729 Aug 01 14:27:08.427885 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-affe7f93-5cc7-487d-b5a6-61245035be2b req-32f9c691-da57-4539-9839-22d45d4dd201 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051700 Aug 01 14:27:08.428500 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 362/738] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:08.666253 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-83a988b8-2aed-4450-b6bf-6c1272be3d72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:08.666964 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-83a988b8-2aed-4450-b6bf-6c1272be3d72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:08.676750 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-83a988b8-2aed-4450-b6bf-6c1272be3d72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:08.679863 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-83a988b8-2aed-4450-b6bf-6c1272be3d72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:08.684589 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-83a988b8-2aed-4450-b6bf-6c1272be3d72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:08.685135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-83a988b8-2aed-4450-b6bf-6c1272be3d72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:08.860162 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-83a988b8-2aed-4450-b6bf-6c1272be3d72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:08.878961 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-83a988b8-2aed-4450-b6bf-6c1272be3d72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:08.881704 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-83a988b8-2aed-4450-b6bf-6c1272be3d72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:08.883199 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-83a988b8-2aed-4450-b6bf-6c1272be3d72 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1740 microversion: 2.20 time: 0.221694 Aug 01 14:27:08.895158 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 377/739] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:08 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:09.909286 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b5ed9976-d664-4ab8-9bb7-4d1f3d7ec532 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:09.910102 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b5ed9976-d664-4ab8-9bb7-4d1f3d7ec532 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:09.916922 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b5ed9976-d664-4ab8-9bb7-4d1f3d7ec532 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:09.917374 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b5ed9976-d664-4ab8-9bb7-4d1f3d7ec532 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:09.918321 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b5ed9976-d664-4ab8-9bb7-4d1f3d7ec532 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:09.918764 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b5ed9976-d664-4ab8-9bb7-4d1f3d7ec532 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:10.116105 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-b5ed9976-d664-4ab8-9bb7-4d1f3d7ec532 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:10.128382 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-b5ed9976-d664-4ab8-9bb7-4d1f3d7ec532 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:10.130205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-b5ed9976-d664-4ab8-9bb7-4d1f3d7ec532 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:10.131690 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b5ed9976-d664-4ab8-9bb7-4d1f3d7ec532 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1740 microversion: 2.20 time: 0.227510 Aug 01 14:27:10.132892 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 363/740] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:09 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:11.157462 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-2a7afbd4-8de6-4847-a700-092f897d17cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:11.158106 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-2a7afbd4-8de6-4847-a700-092f897d17cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:11.182063 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2a7afbd4-8de6-4847-a700-092f897d17cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:11.182514 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2a7afbd4-8de6-4847-a700-092f897d17cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:11.186204 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2a7afbd4-8de6-4847-a700-092f897d17cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:11.186830 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2a7afbd4-8de6-4847-a700-092f897d17cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:11.358962 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2a7afbd4-8de6-4847-a700-092f897d17cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:11.369092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2a7afbd4-8de6-4847-a700-092f897d17cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:11.370812 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2a7afbd4-8de6-4847-a700-092f897d17cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:11.373553 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-2a7afbd4-8de6-4847-a700-092f897d17cf tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1740 microversion: 2.20 time: 0.220223 Aug 01 14:27:11.374272 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 378/741] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:11 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:12.399412 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ed66f34e-be7d-45f0-90b9-f98ed9d1aa69 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:12.400878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ed66f34e-be7d-45f0-90b9-f98ed9d1aa69 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:12.407741 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ed66f34e-be7d-45f0-90b9-f98ed9d1aa69 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:12.408572 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ed66f34e-be7d-45f0-90b9-f98ed9d1aa69 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:12.408973 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ed66f34e-be7d-45f0-90b9-f98ed9d1aa69 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:12.409416 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ed66f34e-be7d-45f0-90b9-f98ed9d1aa69 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:12.772790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ed66f34e-be7d-45f0-90b9-f98ed9d1aa69 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:12.781988 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ed66f34e-be7d-45f0-90b9-f98ed9d1aa69 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:12.783674 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ed66f34e-be7d-45f0-90b9-f98ed9d1aa69 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:12.785013 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ed66f34e-be7d-45f0-90b9-f98ed9d1aa69 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1740 microversion: 2.20 time: 0.390338 Aug 01 14:27:12.785583 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 364/742] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:12 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1740 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:13.305190 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e8b30908-4ba2-4d3b-81f3-eb1fb33351c7 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:13.308043 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e8b30908-4ba2-4d3b-81f3-eb1fb33351c7 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:13.316840 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e8b30908-4ba2-4d3b-81f3-eb1fb33351c7 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:13.317545 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e8b30908-4ba2-4d3b-81f3-eb1fb33351c7 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:13.318521 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e8b30908-4ba2-4d3b-81f3-eb1fb33351c7 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:13.319117 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e8b30908-4ba2-4d3b-81f3-eb1fb33351c7 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:13.358272 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e8b30908-4ba2-4d3b-81f3-eb1fb33351c7 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057240 Aug 01 14:27:13.360063 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 379/743] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:27:13 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:13.371360 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0dbc95f1-943c-4d6e-bb4f-1c2f2f284d5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:13.372009 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0dbc95f1-943c-4d6e-bb4f-1c2f2f284d5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:13.379153 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0dbc95f1-943c-4d6e-bb4f-1c2f2f284d5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:13.379878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0dbc95f1-943c-4d6e-bb4f-1c2f2f284d5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:13.380975 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0dbc95f1-943c-4d6e-bb4f-1c2f2f284d5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:13.381576 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0dbc95f1-943c-4d6e-bb4f-1c2f2f284d5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:13.412195 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0dbc95f1-943c-4d6e-bb4f-1c2f2f284d5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments/2e2eaa3d-debd-4616-9933-2deb18f54b37" status: 200 len: 194 microversion: 2.1 time: 0.045115 Aug 01 14:27:13.413521 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 365/744] 10.222.0.49 () {58 vars in 1413 bytes} [Mon Aug 1 14:27:13 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments/2e2eaa3d-debd-4616-9933-2deb18f54b37 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:13.810905 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f90d28fa-9cfa-4d2f-b048-8969a5d626db tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:13.813395 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f90d28fa-9cfa-4d2f-b048-8969a5d626db tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:13.820485 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f90d28fa-9cfa-4d2f-b048-8969a5d626db tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:13.821185 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f90d28fa-9cfa-4d2f-b048-8969a5d626db tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:13.822135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f90d28fa-9cfa-4d2f-b048-8969a5d626db tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:13.822765 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f90d28fa-9cfa-4d2f-b048-8969a5d626db tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:14.016216 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f90d28fa-9cfa-4d2f-b048-8969a5d626db tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:14.026808 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f90d28fa-9cfa-4d2f-b048-8969a5d626db tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:14.029669 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f90d28fa-9cfa-4d2f-b048-8969a5d626db tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:14.034691 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f90d28fa-9cfa-4d2f-b048-8969a5d626db tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1740 microversion: 2.20 time: 0.224935 Aug 01 14:27:14.034691 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 380/745] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:13 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:15.059571 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-11439b9e-faca-4a0b-a6b6-c107e7394a54 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:15.060241 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-11439b9e-faca-4a0b-a6b6-c107e7394a54 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:15.068686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-11439b9e-faca-4a0b-a6b6-c107e7394a54 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:15.069556 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-11439b9e-faca-4a0b-a6b6-c107e7394a54 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:15.070588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-11439b9e-faca-4a0b-a6b6-c107e7394a54 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:15.071374 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-11439b9e-faca-4a0b-a6b6-c107e7394a54 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:15.228514 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-11439b9e-faca-4a0b-a6b6-c107e7394a54 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:15.237460 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-11439b9e-faca-4a0b-a6b6-c107e7394a54 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:15.239279 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-11439b9e-faca-4a0b-a6b6-c107e7394a54 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:15.240451 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-11439b9e-faca-4a0b-a6b6-c107e7394a54 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1740 microversion: 2.20 time: 0.184873 Aug 01 14:27:15.241261 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 366/746] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:15 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:16.269176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f97347ff-e721-4ea7-a73e-65768cc71806 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:16.269810 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f97347ff-e721-4ea7-a73e-65768cc71806 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:16.273310 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=40 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:16.276805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f97347ff-e721-4ea7-a73e-65768cc71806 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:16.277254 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f97347ff-e721-4ea7-a73e-65768cc71806 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:16.278212 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f97347ff-e721-4ea7-a73e-65768cc71806 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:16.278651 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f97347ff-e721-4ea7-a73e-65768cc71806 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:16.437966 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f97347ff-e721-4ea7-a73e-65768cc71806 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:16.450184 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f97347ff-e721-4ea7-a73e-65768cc71806 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:16.451762 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f97347ff-e721-4ea7-a73e-65768cc71806 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:16.453674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f97347ff-e721-4ea7-a73e-65768cc71806 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1740 microversion: 2.20 time: 0.190914 Aug 01 14:27:16.465777 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 381/747] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:16 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:17.232305 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-268e7692-4c93-4f43-83da-1554c0fdcb8a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5696f8f6-ba11-46af-a936-966680e35857"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:17.235425 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-268e7692-4c93-4f43-83da-1554c0fdcb8a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:17.242208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-268e7692-4c93-4f43-83da-1554c0fdcb8a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:17.242657 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-268e7692-4c93-4f43-83da-1554c0fdcb8a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:17.243417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-268e7692-4c93-4f43-83da-1554c0fdcb8a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:17.243847 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-268e7692-4c93-4f43-83da-1554c0fdcb8a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:17.477001 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-bf5a6121-0b97-4875-94f2-7f7b55840311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:17.477800 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-bf5a6121-0b97-4875-94f2-7f7b55840311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:17.484633 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bf5a6121-0b97-4875-94f2-7f7b55840311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:17.485093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bf5a6121-0b97-4875-94f2-7f7b55840311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:17.485919 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bf5a6121-0b97-4875-94f2-7f7b55840311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:17.486370 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bf5a6121-0b97-4875-94f2-7f7b55840311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:17.627871 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bf5a6121-0b97-4875-94f2-7f7b55840311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:17.635837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bf5a6121-0b97-4875-94f2-7f7b55840311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:17.637339 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bf5a6121-0b97-4875-94f2-7f7b55840311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:17.638523 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-bf5a6121-0b97-4875-94f2-7f7b55840311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1740 microversion: 2.20 time: 0.165613 Aug 01 14:27:17.639080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 382/748] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:17 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:27:18.431002 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-268e7692-4c93-4f43-83da-1554c0fdcb8a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "POST /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.202486 Aug 01 14:27:18.431558 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 367/749] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Aug 1 14:27:17 2022] POST /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments => generated 194 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:18.661828 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-83dde683-cc04-4d9c-a1c9-29ede17c2fa5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:18.662445 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-83dde683-cc04-4d9c-a1c9-29ede17c2fa5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:18.669169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-83dde683-cc04-4d9c-a1c9-29ede17c2fa5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:18.669698 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-83dde683-cc04-4d9c-a1c9-29ede17c2fa5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:18.670560 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-83dde683-cc04-4d9c-a1c9-29ede17c2fa5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:18.671004 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-83dde683-cc04-4d9c-a1c9-29ede17c2fa5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:18.811513 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-83dde683-cc04-4d9c-a1c9-29ede17c2fa5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:18.820216 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-83dde683-cc04-4d9c-a1c9-29ede17c2fa5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:18.821760 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-83dde683-cc04-4d9c-a1c9-29ede17c2fa5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:18.822933 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-83dde683-cc04-4d9c-a1c9-29ede17c2fa5 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1722 microversion: 2.20 time: 0.165233 Aug 01 14:27:18.823492 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 383/750] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:18 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:19.847639 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1fb666da-42c9-4953-b031-5477b5e22c04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:19.852235 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-1fb666da-42c9-4953-b031-5477b5e22c04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:19.852235 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=32 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:19.856016 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1fb666da-42c9-4953-b031-5477b5e22c04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:19.856492 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1fb666da-42c9-4953-b031-5477b5e22c04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:19.857264 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1fb666da-42c9-4953-b031-5477b5e22c04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:19.857696 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1fb666da-42c9-4953-b031-5477b5e22c04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:19.995777 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-1fb666da-42c9-4953-b031-5477b5e22c04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:20.004521 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-1fb666da-42c9-4953-b031-5477b5e22c04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:20.006390 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-1fb666da-42c9-4953-b031-5477b5e22c04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:20.007682 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-1fb666da-42c9-4953-b031-5477b5e22c04 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1722 microversion: 2.20 time: 0.165155 Aug 01 14:27:20.008228 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 368/751] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:19 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:21.031422 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-5f0c7033-ec7f-4f17-bfaa-2500df281468 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:21.032836 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-5f0c7033-ec7f-4f17-bfaa-2500df281468 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:21.039846 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5f0c7033-ec7f-4f17-bfaa-2500df281468 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:21.040570 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5f0c7033-ec7f-4f17-bfaa-2500df281468 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:21.041359 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5f0c7033-ec7f-4f17-bfaa-2500df281468 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:21.041864 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5f0c7033-ec7f-4f17-bfaa-2500df281468 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:21.174226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-5f0c7033-ec7f-4f17-bfaa-2500df281468 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:21.182117 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-5f0c7033-ec7f-4f17-bfaa-2500df281468 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:21.183636 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-5f0c7033-ec7f-4f17-bfaa-2500df281468 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:21.184791 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-5f0c7033-ec7f-4f17-bfaa-2500df281468 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1665 microversion: 2.20 time: 0.157368 Aug 01 14:27:21.185357 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 384/752] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:21 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:21.206809 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0ecc2a7c-8fea-4d98-8cc1-162a966e0097 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "951357f1-61eb-4041-acea-b86af43cc0af"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:21.209237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0ecc2a7c-8fea-4d98-8cc1-162a966e0097 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:21.215975 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0ecc2a7c-8fea-4d98-8cc1-162a966e0097 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:21.217477 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0ecc2a7c-8fea-4d98-8cc1-162a966e0097 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:21.217477 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0ecc2a7c-8fea-4d98-8cc1-162a966e0097 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:21.217725 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0ecc2a7c-8fea-4d98-8cc1-162a966e0097 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:22.288212 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0ecc2a7c-8fea-4d98-8cc1-162a966e0097 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "POST /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.085575 Aug 01 14:27:22.289184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 369/753] 10.222.0.49 () {62 vars in 1364 bytes} [Mon Aug 1 14:27:21 2022] POST /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82/os-volume_attachments => generated 188 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:27:22.426032 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b0f6666e-eb93-457a-88dc-4ed6fbe40496 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:22.426637 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b0f6666e-eb93-457a-88dc-4ed6fbe40496 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:22.436474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b0f6666e-eb93-457a-88dc-4ed6fbe40496 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:22.444906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b0f6666e-eb93-457a-88dc-4ed6fbe40496 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:22.444906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b0f6666e-eb93-457a-88dc-4ed6fbe40496 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:22.444906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b0f6666e-eb93-457a-88dc-4ed6fbe40496 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:22.454576 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-4b531ffd-0813-486b-8cde-fd35f0f9db9b req-f364a9ce-b5c2-441b-873d-997088f9ed08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015b4877-f47b-4e45-a2b8-e36ba4bacf82", "name": "network-vif-unplugged", "status": "completed", "tag": "09014052-8b79-46d5-99ce-d8c6b6ccd445"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:22.470606 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-4b531ffd-0813-486b-8cde-fd35f0f9db9b req-f364a9ce-b5c2-441b-873d-997088f9ed08 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:22.473432 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-4b531ffd-0813-486b-8cde-fd35f0f9db9b req-f364a9ce-b5c2-441b-873d-997088f9ed08 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:22.482708 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.compute.server_external_events [req-4b531ffd-0813-486b-8cde-fd35f0f9db9b req-f364a9ce-b5c2-441b-873d-997088f9ed08 service nova] Unable to find a host for instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82. Dropping event network-vif-unplugged {{(pid=118246) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 01 14:27:22.483594 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-4b531ffd-0813-486b-8cde-fd35f0f9db9b req-f364a9ce-b5c2-441b-873d-997088f9ed08 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033136 Aug 01 14:27:22.484189 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 370/754] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 01 14:27:23.144844 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b0f6666e-eb93-457a-88dc-4ed6fbe40496 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "DELETE /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82/os-volume_attachments/951357f1-61eb-4041-acea-b86af43cc0af" status: 202 len: 0 microversion: 2.20 time: 0.724505 Aug 01 14:27:23.145428 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 385/755] 10.222.0.49 () {60 vars in 1457 bytes} [Mon Aug 1 14:27:22 2022] DELETE /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82/os-volume_attachments/951357f1-61eb-4041-acea-b86af43cc0af => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:27:23.206056 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1975da30-449d-4c13-ae43-96f4e1ac5aed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:23.206713 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-1975da30-449d-4c13-ae43-96f4e1ac5aed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:23.212828 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1975da30-449d-4c13-ae43-96f4e1ac5aed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:23.213287 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1975da30-449d-4c13-ae43-96f4e1ac5aed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:23.214121 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1975da30-449d-4c13-ae43-96f4e1ac5aed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:23.214563 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1975da30-449d-4c13-ae43-96f4e1ac5aed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:23.260271 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-1975da30-449d-4c13-ae43-96f4e1ac5aed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118246) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 14:27:23.402994 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=9,nova_cell1:INSERT=5 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:23.651278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-1975da30-449d-4c13-ae43-96f4e1ac5aed tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "POST /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82/action" status: 202 len: 0 microversion: 2.20 time: 0.449489 Aug 01 14:27:23.655281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 371/756] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Aug 1 14:27:23 2022] POST /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:27:23.660969 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f7be10ff-97f8-4368-9244-022574f43034 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:23.661711 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f7be10ff-97f8-4368-9244-022574f43034 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:23.668451 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f7be10ff-97f8-4368-9244-022574f43034 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:23.668839 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f7be10ff-97f8-4368-9244-022574f43034 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:23.669624 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f7be10ff-97f8-4368-9244-022574f43034 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:23.670089 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f7be10ff-97f8-4368-9244-022574f43034 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:23.854568 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f7be10ff-97f8-4368-9244-022574f43034 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:23.877252 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f7be10ff-97f8-4368-9244-022574f43034 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:23.878831 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f7be10ff-97f8-4368-9244-022574f43034 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:23.880052 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f7be10ff-97f8-4368-9244-022574f43034 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1673 microversion: 2.20 time: 0.223659 Aug 01 14:27:23.880757 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 386/757] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:23 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1673 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:27:24.904588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-be001ce5-e4ea-4e9f-b583-628f1bb46540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:24.905318 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-be001ce5-e4ea-4e9f-b583-628f1bb46540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:24.911753 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-be001ce5-e4ea-4e9f-b583-628f1bb46540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:24.912286 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-be001ce5-e4ea-4e9f-b583-628f1bb46540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:24.913133 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-be001ce5-e4ea-4e9f-b583-628f1bb46540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:24.913817 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-be001ce5-e4ea-4e9f-b583-628f1bb46540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:25.046136 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-be001ce5-e4ea-4e9f-b583-628f1bb46540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:25.054597 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-be001ce5-e4ea-4e9f-b583-628f1bb46540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:25.056101 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-be001ce5-e4ea-4e9f-b583-628f1bb46540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:25.057261 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-be001ce5-e4ea-4e9f-b583-628f1bb46540 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1673 microversion: 2.20 time: 0.157495 Aug 01 14:27:25.057904 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 372/758] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:24 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:26.081446 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1db7c47f-b94f-44fa-9b0d-c3ace53bd6a7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:26.082083 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1db7c47f-b94f-44fa-9b0d-c3ace53bd6a7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:26.088501 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1db7c47f-b94f-44fa-9b0d-c3ace53bd6a7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:26.089035 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1db7c47f-b94f-44fa-9b0d-c3ace53bd6a7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:26.089895 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1db7c47f-b94f-44fa-9b0d-c3ace53bd6a7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:26.090335 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1db7c47f-b94f-44fa-9b0d-c3ace53bd6a7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:26.219689 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1db7c47f-b94f-44fa-9b0d-c3ace53bd6a7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:26.227804 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1db7c47f-b94f-44fa-9b0d-c3ace53bd6a7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:26.229287 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1db7c47f-b94f-44fa-9b0d-c3ace53bd6a7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:26.230457 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1db7c47f-b94f-44fa-9b0d-c3ace53bd6a7 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.153559 Aug 01 14:27:26.231008 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 387/759] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:26 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:27.254303 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-bfd7fbd5-9f20-4db5-984d-ec84e4ba4594 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:27.254854 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-bfd7fbd5-9f20-4db5-984d-ec84e4ba4594 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:27.261414 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bfd7fbd5-9f20-4db5-984d-ec84e4ba4594 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:27.261958 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bfd7fbd5-9f20-4db5-984d-ec84e4ba4594 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:27.262728 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bfd7fbd5-9f20-4db5-984d-ec84e4ba4594 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:27.263174 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bfd7fbd5-9f20-4db5-984d-ec84e4ba4594 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:27.392863 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-bfd7fbd5-9f20-4db5-984d-ec84e4ba4594 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:27.400775 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-bfd7fbd5-9f20-4db5-984d-ec84e4ba4594 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:27.402367 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-bfd7fbd5-9f20-4db5-984d-ec84e4ba4594 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:27.403526 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-bfd7fbd5-9f20-4db5-984d-ec84e4ba4594 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.154140 Aug 01 14:27:27.404199 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 373/760] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:27 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:28.192250 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-36df5bb5-94dd-4aac-b8d2-3365ab98ebaa tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:28.194781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-36df5bb5-94dd-4aac-b8d2-3365ab98ebaa tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:28.201467 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-36df5bb5-94dd-4aac-b8d2-3365ab98ebaa tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:28.202421 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-36df5bb5-94dd-4aac-b8d2-3365ab98ebaa tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:28.202885 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-36df5bb5-94dd-4aac-b8d2-3365ab98ebaa tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:28.203327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-36df5bb5-94dd-4aac-b8d2-3365ab98ebaa tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:28.244604 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-36df5bb5-94dd-4aac-b8d2-3365ab98ebaa tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049206 Aug 01 14:27:28.244604 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 388/761] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:27:28 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:28.379113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-652e41e5-d701-4ef8-83f4-2c15004e0c5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:28.379650 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-652e41e5-d701-4ef8-83f4-2c15004e0c5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:28.386629 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-652e41e5-d701-4ef8-83f4-2c15004e0c5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:28.387104 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-652e41e5-d701-4ef8-83f4-2c15004e0c5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:28.387872 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-652e41e5-d701-4ef8-83f4-2c15004e0c5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:28.388318 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-652e41e5-d701-4ef8-83f4-2c15004e0c5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:28.419281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-652e41e5-d701-4ef8-83f4-2c15004e0c5b tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments/2e2eaa3d-debd-4616-9933-2deb18f54b37" status: 200 len: 194 microversion: 2.1 time: 0.044300 Aug 01 14:27:28.425002 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 374/762] 10.222.0.49 () {58 vars in 1413 bytes} [Mon Aug 1 14:27:28 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments/2e2eaa3d-debd-4616-9933-2deb18f54b37 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:28.426323 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d0aae0a6-2ef0-4b44-b949-87703eb2b489 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:28.426934 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d0aae0a6-2ef0-4b44-b949-87703eb2b489 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:28.430031 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-bc47297d-2711-4173-b4ea-d183d38bfe86 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:28.430520 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-bc47297d-2711-4173-b4ea-d183d38bfe86 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:28.432989 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d0aae0a6-2ef0-4b44-b949-87703eb2b489 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:28.433442 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d0aae0a6-2ef0-4b44-b949-87703eb2b489 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:28.434246 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d0aae0a6-2ef0-4b44-b949-87703eb2b489 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:28.434685 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d0aae0a6-2ef0-4b44-b949-87703eb2b489 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:28.436709 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bc47297d-2711-4173-b4ea-d183d38bfe86 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:28.437142 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bc47297d-2711-4173-b4ea-d183d38bfe86 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:28.438477 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bc47297d-2711-4173-b4ea-d183d38bfe86 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:28.438945 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bc47297d-2711-4173-b4ea-d183d38bfe86 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:28.550619 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-bc47297d-2711-4173-b4ea-d183d38bfe86 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lazy-loading 'services' on Instance uuid 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:27:28.597698 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d0aae0a6-2ef0-4b44-b949-87703eb2b489 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:28.606167 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d0aae0a6-2ef0-4b44-b949-87703eb2b489 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:28.607694 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d0aae0a6-2ef0-4b44-b949-87703eb2b489 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:28.608856 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d0aae0a6-2ef0-4b44-b949-87703eb2b489 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.186743 Aug 01 14:27:28.609674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 389/763] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:28 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:28.802148 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-bc47297d-2711-4173-b4ea-d183d38bfe86 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "DELETE /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments/2e2eaa3d-debd-4616-9933-2deb18f54b37" status: 202 len: 0 microversion: 2.1 time: 0.375714 Aug 01 14:27:28.802732 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 375/764] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Aug 1 14:27:28 2022] DELETE /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments/2e2eaa3d-debd-4616-9933-2deb18f54b37 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:27:29.631541 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-48cf8706-14bb-4f24-abce-48decf2886e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:29.632159 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-48cf8706-14bb-4f24-abce-48decf2886e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:29.639557 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-48cf8706-14bb-4f24-abce-48decf2886e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:29.640152 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-48cf8706-14bb-4f24-abce-48decf2886e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:29.642172 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-48cf8706-14bb-4f24-abce-48decf2886e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:29.642633 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-48cf8706-14bb-4f24-abce-48decf2886e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:29.665490 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:29.810760 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-48cf8706-14bb-4f24-abce-48decf2886e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:29.819285 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-48cf8706-14bb-4f24-abce-48decf2886e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:29.820799 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-48cf8706-14bb-4f24-abce-48decf2886e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:29.822009 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-48cf8706-14bb-4f24-abce-48decf2886e6 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.194707 Aug 01 14:27:29.822615 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 390/765] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:29 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:30.850721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-00ffcdab-f2b6-41d1-a633-33cae459ec7f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:30.851633 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-00ffcdab-f2b6-41d1-a633-33cae459ec7f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:30.860660 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-00ffcdab-f2b6-41d1-a633-33cae459ec7f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:30.861179 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-00ffcdab-f2b6-41d1-a633-33cae459ec7f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:30.862000 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-00ffcdab-f2b6-41d1-a633-33cae459ec7f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:30.862443 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-00ffcdab-f2b6-41d1-a633-33cae459ec7f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:31.042655 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-00ffcdab-f2b6-41d1-a633-33cae459ec7f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:31.049386 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-00ffcdab-f2b6-41d1-a633-33cae459ec7f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:31.051222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-00ffcdab-f2b6-41d1-a633-33cae459ec7f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:31.052497 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-00ffcdab-f2b6-41d1-a633-33cae459ec7f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.208121 Aug 01 14:27:31.053059 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 376/766] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:30 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:32.081514 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e6e3a7fe-e0bb-4991-9a9c-0181dfac27f8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:32.082782 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e6e3a7fe-e0bb-4991-9a9c-0181dfac27f8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:32.090572 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e6e3a7fe-e0bb-4991-9a9c-0181dfac27f8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:32.090955 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e6e3a7fe-e0bb-4991-9a9c-0181dfac27f8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:32.091745 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e6e3a7fe-e0bb-4991-9a9c-0181dfac27f8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:32.092188 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e6e3a7fe-e0bb-4991-9a9c-0181dfac27f8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:32.245530 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e6e3a7fe-e0bb-4991-9a9c-0181dfac27f8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:32.254227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e6e3a7fe-e0bb-4991-9a9c-0181dfac27f8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:32.255758 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e6e3a7fe-e0bb-4991-9a9c-0181dfac27f8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:32.256973 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e6e3a7fe-e0bb-4991-9a9c-0181dfac27f8 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.180440 Aug 01 14:27:32.257539 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 391/767] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:32 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:33.282320 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7a86dcaa-6e33-46e8-9579-0e2edf103be9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:33.284023 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7a86dcaa-6e33-46e8-9579-0e2edf103be9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:33.291550 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7a86dcaa-6e33-46e8-9579-0e2edf103be9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:33.292256 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7a86dcaa-6e33-46e8-9579-0e2edf103be9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:33.293036 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7a86dcaa-6e33-46e8-9579-0e2edf103be9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:33.293479 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7a86dcaa-6e33-46e8-9579-0e2edf103be9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:33.447639 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7a86dcaa-6e33-46e8-9579-0e2edf103be9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:33.459166 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7a86dcaa-6e33-46e8-9579-0e2edf103be9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:33.463257 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7a86dcaa-6e33-46e8-9579-0e2edf103be9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:33.464675 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7a86dcaa-6e33-46e8-9579-0e2edf103be9 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.188299 Aug 01 14:27:33.480490 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 377/768] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:33 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:34.498358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-254ca470-0d75-4233-9fec-ccb2e655993c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:34.499071 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-254ca470-0d75-4233-9fec-ccb2e655993c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:34.507636 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-254ca470-0d75-4233-9fec-ccb2e655993c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:34.508087 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-254ca470-0d75-4233-9fec-ccb2e655993c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:34.508871 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-254ca470-0d75-4233-9fec-ccb2e655993c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:34.509314 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-254ca470-0d75-4233-9fec-ccb2e655993c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:34.668726 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-254ca470-0d75-4233-9fec-ccb2e655993c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:34.678792 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-254ca470-0d75-4233-9fec-ccb2e655993c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:34.680367 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-254ca470-0d75-4233-9fec-ccb2e655993c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:34.681570 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-254ca470-0d75-4233-9fec-ccb2e655993c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.188544 Aug 01 14:27:34.682630 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 392/769] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:34 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:35.708227 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f5645a24-b6f0-40b5-8112-f78632ade72a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:35.709319 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f5645a24-b6f0-40b5-8112-f78632ade72a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:35.717552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f5645a24-b6f0-40b5-8112-f78632ade72a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:35.718747 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f5645a24-b6f0-40b5-8112-f78632ade72a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:35.719824 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f5645a24-b6f0-40b5-8112-f78632ade72a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:35.720242 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f5645a24-b6f0-40b5-8112-f78632ade72a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:35.883984 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f5645a24-b6f0-40b5-8112-f78632ade72a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:35.895239 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f5645a24-b6f0-40b5-8112-f78632ade72a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:35.897332 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f5645a24-b6f0-40b5-8112-f78632ade72a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:35.898712 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f5645a24-b6f0-40b5-8112-f78632ade72a tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.195461 Aug 01 14:27:35.900168 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 378/770] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:35 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:36.927154 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a2bd61cb-e3b4-49ee-8fa2-38b98d7871cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:36.927782 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a2bd61cb-e3b4-49ee-8fa2-38b98d7871cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:36.933919 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a2bd61cb-e3b4-49ee-8fa2-38b98d7871cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:36.938224 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a2bd61cb-e3b4-49ee-8fa2-38b98d7871cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:36.938224 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a2bd61cb-e3b4-49ee-8fa2-38b98d7871cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:36.938224 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a2bd61cb-e3b4-49ee-8fa2-38b98d7871cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:37.113426 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a2bd61cb-e3b4-49ee-8fa2-38b98d7871cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:37.122964 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a2bd61cb-e3b4-49ee-8fa2-38b98d7871cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:37.124491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a2bd61cb-e3b4-49ee-8fa2-38b98d7871cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:37.126136 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a2bd61cb-e3b4-49ee-8fa2-38b98d7871cd tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.204067 Aug 01 14:27:37.126897 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 393/771] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:36 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:38.150275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f9e76080-8742-4085-b288-eb1554677d85 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:38.150922 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f9e76080-8742-4085-b288-eb1554677d85 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:38.158530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f9e76080-8742-4085-b288-eb1554677d85 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:38.159192 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f9e76080-8742-4085-b288-eb1554677d85 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:38.159968 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f9e76080-8742-4085-b288-eb1554677d85 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:38.160408 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f9e76080-8742-4085-b288-eb1554677d85 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:38.295009 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f9e76080-8742-4085-b288-eb1554677d85 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:38.323541 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f9e76080-8742-4085-b288-eb1554677d85 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:38.323541 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f9e76080-8742-4085-b288-eb1554677d85 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:38.323541 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f9e76080-8742-4085-b288-eb1554677d85 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.160558 Aug 01 14:27:38.323979 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 379/772] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:38 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:39.336515 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-87cf1a8f-b1c4-4310-aa36-104f33c21f31 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:39.337133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-87cf1a8f-b1c4-4310-aa36-104f33c21f31 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:39.343700 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-87cf1a8f-b1c4-4310-aa36-104f33c21f31 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:39.344155 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-87cf1a8f-b1c4-4310-aa36-104f33c21f31 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:39.345555 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-87cf1a8f-b1c4-4310-aa36-104f33c21f31 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:39.346036 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-87cf1a8f-b1c4-4310-aa36-104f33c21f31 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:39.515712 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-87cf1a8f-b1c4-4310-aa36-104f33c21f31 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:39.524461 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-87cf1a8f-b1c4-4310-aa36-104f33c21f31 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:39.525975 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-87cf1a8f-b1c4-4310-aa36-104f33c21f31 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:39.527129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-87cf1a8f-b1c4-4310-aa36-104f33c21f31 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.194559 Aug 01 14:27:39.527678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 394/773] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:39 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:39.552651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-6ed0d3f1-c16c-4d62-88cc-845b61fc2b9d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:39.553169 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-6ed0d3f1-c16c-4d62-88cc-845b61fc2b9d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:39.559658 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6ed0d3f1-c16c-4d62-88cc-845b61fc2b9d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:39.560106 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6ed0d3f1-c16c-4d62-88cc-845b61fc2b9d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:39.560860 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6ed0d3f1-c16c-4d62-88cc-845b61fc2b9d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:39.561295 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6ed0d3f1-c16c-4d62-88cc-845b61fc2b9d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:39.590794 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-6ed0d3f1-c16c-4d62-88cc-845b61fc2b9d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments/5696f8f6-ba11-46af-a936-966680e35857" status: 200 len: 194 microversion: 2.1 time: 0.041930 Aug 01 14:27:39.591310 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 380/774] 10.222.0.49 () {58 vars in 1413 bytes} [Mon Aug 1 14:27:39 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments/5696f8f6-ba11-46af-a936-966680e35857 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:39.602477 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ce4fdb8d-5684-4aaf-bb7f-c080cdd73593 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:39.602978 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ce4fdb8d-5684-4aaf-bb7f-c080cdd73593 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:39.609081 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ce4fdb8d-5684-4aaf-bb7f-c080cdd73593 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:39.609562 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ce4fdb8d-5684-4aaf-bb7f-c080cdd73593 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:39.610352 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ce4fdb8d-5684-4aaf-bb7f-c080cdd73593 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:39.610787 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ce4fdb8d-5684-4aaf-bb7f-c080cdd73593 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:39.693611 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-ce4fdb8d-5684-4aaf-bb7f-c080cdd73593 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lazy-loading 'services' on Instance uuid 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:27:39.937297 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ce4fdb8d-5684-4aaf-bb7f-c080cdd73593 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "DELETE /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments/5696f8f6-ba11-46af-a936-966680e35857" status: 202 len: 0 microversion: 2.1 time: 0.338663 Aug 01 14:27:39.945641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 395/775] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Aug 1 14:27:39 2022] DELETE /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments/5696f8f6-ba11-46af-a936-966680e35857 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:27:40.554580 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-beade6dd-9c38-4d3d-855f-a2572560bc2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:40.556355 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-beade6dd-9c38-4d3d-855f-a2572560bc2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:40.563640 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-beade6dd-9c38-4d3d-855f-a2572560bc2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:40.564129 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-beade6dd-9c38-4d3d-855f-a2572560bc2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:40.564956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-beade6dd-9c38-4d3d-855f-a2572560bc2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:40.565484 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-beade6dd-9c38-4d3d-855f-a2572560bc2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:40.814947 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-beade6dd-9c38-4d3d-855f-a2572560bc2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:40.824031 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-beade6dd-9c38-4d3d-855f-a2572560bc2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:40.825519 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-beade6dd-9c38-4d3d-855f-a2572560bc2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:40.827062 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-beade6dd-9c38-4d3d-855f-a2572560bc2c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.279388 Aug 01 14:27:40.832737 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 381/776] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:40 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:27:41.159432 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-234ccc16-6f60-49b5-a462-d29f547f037a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:41.162375 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-234ccc16-6f60-49b5-a462-d29f547f037a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:41.170206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-234ccc16-6f60-49b5-a462-d29f547f037a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:41.173905 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-234ccc16-6f60-49b5-a462-d29f547f037a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:41.173905 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-234ccc16-6f60-49b5-a462-d29f547f037a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:41.173905 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-234ccc16-6f60-49b5-a462-d29f547f037a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:41.218190 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-234ccc16-6f60-49b5-a462-d29f547f037a tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063875 Aug 01 14:27:41.219025 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 396/777] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:27:41 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 14:27:41.355711 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-39f273e3-708c-40df-8b4a-b7fea948381d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:41.358450 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-39f273e3-708c-40df-8b4a-b7fea948381d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:41.365474 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-39f273e3-708c-40df-8b4a-b7fea948381d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:41.366212 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-39f273e3-708c-40df-8b4a-b7fea948381d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:41.367340 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-39f273e3-708c-40df-8b4a-b7fea948381d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:41.367785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-39f273e3-708c-40df-8b4a-b7fea948381d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:41.398350 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-39f273e3-708c-40df-8b4a-b7fea948381d tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046460 Aug 01 14:27:41.398928 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 382/778] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:27:41 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:27:41.469052 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-95ec3276-2eeb-4691-88f3-5c77ffae2282 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:41.469581 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-95ec3276-2eeb-4691-88f3-5c77ffae2282 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:41.476861 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-95ec3276-2eeb-4691-88f3-5c77ffae2282 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:41.477316 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-95ec3276-2eeb-4691-88f3-5c77ffae2282 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:41.481710 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-95ec3276-2eeb-4691-88f3-5c77ffae2282 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:41.481710 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-95ec3276-2eeb-4691-88f3-5c77ffae2282 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:41.510191 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-95ec3276-2eeb-4691-88f3-5c77ffae2282 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Going to try to terminate instance {{(pid=118247) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:27:41.812557 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-95ec3276-2eeb-4691-88f3-5c77ffae2282 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "DELETE /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 204 len: 0 microversion: 2.1 time: 0.346925 Aug 01 14:27:41.813149 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 397/779] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:27:41 2022] DELETE /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:27:41.822088 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f9d50a7a-68d7-48ac-9c96-81a96708a8f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:41.822698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f9d50a7a-68d7-48ac-9c96-81a96708a8f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:41.829177 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f9d50a7a-68d7-48ac-9c96-81a96708a8f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:41.829627 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f9d50a7a-68d7-48ac-9c96-81a96708a8f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:41.830556 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f9d50a7a-68d7-48ac-9c96-81a96708a8f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:41.830960 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f9d50a7a-68d7-48ac-9c96-81a96708a8f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:41.857784 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-46514eb8-b17c-4243-b1ec-2508eecd083e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:41.857912 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-46514eb8-b17c-4243-b1ec-2508eecd083e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:41.872414 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-46514eb8-b17c-4243-b1ec-2508eecd083e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:41.872976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-46514eb8-b17c-4243-b1ec-2508eecd083e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:41.873648 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-46514eb8-b17c-4243-b1ec-2508eecd083e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:41.874122 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-46514eb8-b17c-4243-b1ec-2508eecd083e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:42.035694 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f9d50a7a-68d7-48ac-9c96-81a96708a8f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:42.043245 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f9d50a7a-68d7-48ac-9c96-81a96708a8f3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1674 microversion: 2.1 time: 0.224823 Aug 01 14:27:42.044345 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 383/780] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:41 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1674 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:42.092633 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-46514eb8-b17c-4243-b1ec-2508eecd083e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:42.102875 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-46514eb8-b17c-4243-b1ec-2508eecd083e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:42.104842 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-46514eb8-b17c-4243-b1ec-2508eecd083e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:42.106120 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-46514eb8-b17c-4243-b1ec-2508eecd083e tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.259451 Aug 01 14:27:42.106687 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 398/781] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:41 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:42.754594 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-b7061777-305a-4dda-88c5-51dc4f95de04 req-dd0ffd31-9ba3-420d-9c0c-ca963a1af575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015b4877-f47b-4e45-a2b8-e36ba4bacf82", "name": "network-vif-plugged", "status": "completed", "tag": "09014052-8b79-46d5-99ce-d8c6b6ccd445"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:42.764009 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-b7061777-305a-4dda-88c5-51dc4f95de04 req-dd0ffd31-9ba3-420d-9c0c-ca963a1af575 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:42.764460 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-b7061777-305a-4dda-88c5-51dc4f95de04 req-dd0ffd31-9ba3-420d-9c0c-ca963a1af575 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:42.776342 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-b7061777-305a-4dda-88c5-51dc4f95de04 req-dd0ffd31-9ba3-420d-9c0c-ca963a1af575 service nova] Creating event network-vif-plugged:09014052-8b79-46d5-99ce-d8c6b6ccd445 for instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 on hv-cinder-78729 Aug 01 14:27:42.781372 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-b7061777-305a-4dda-88c5-51dc4f95de04 req-dd0ffd31-9ba3-420d-9c0c-ca963a1af575 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031042 Aug 01 14:27:42.782184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 384/782] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:43.067683 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-61e3bee0-b35e-48a0-9c72-769a90668a05 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:43.068298 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-61e3bee0-b35e-48a0-9c72-769a90668a05 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:43.074870 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-61e3bee0-b35e-48a0-9c72-769a90668a05 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:43.075326 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-61e3bee0-b35e-48a0-9c72-769a90668a05 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:43.076097 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-61e3bee0-b35e-48a0-9c72-769a90668a05 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:43.076645 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-61e3bee0-b35e-48a0-9c72-769a90668a05 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:43.133276 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8bbcdf7a-de74-4851-bc05-19e6f39a6a51 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:43.135507 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8bbcdf7a-de74-4851-bc05-19e6f39a6a51 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:43.160420 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8bbcdf7a-de74-4851-bc05-19e6f39a6a51 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:43.162977 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8bbcdf7a-de74-4851-bc05-19e6f39a6a51 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:43.164378 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8bbcdf7a-de74-4851-bc05-19e6f39a6a51 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:43.165028 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8bbcdf7a-de74-4851-bc05-19e6f39a6a51 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:43.268100 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-61e3bee0-b35e-48a0-9c72-769a90668a05 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:43.280463 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-61e3bee0-b35e-48a0-9c72-769a90668a05 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1674 microversion: 2.1 time: 0.213728 Aug 01 14:27:43.280463 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 399/783] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:43 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1674 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:43.343153 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8bbcdf7a-de74-4851-bc05-19e6f39a6a51 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:43.353386 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8bbcdf7a-de74-4851-bc05-19e6f39a6a51 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:43.356041 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8bbcdf7a-de74-4851-bc05-19e6f39a6a51 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:43.357911 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8bbcdf7a-de74-4851-bc05-19e6f39a6a51 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.229689 Aug 01 14:27:43.364992 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 385/784] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:43 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:27:44.302708 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ea8a586c-7c8d-4532-aae5-e190812d89a3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:44.303348 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ea8a586c-7c8d-4532-aae5-e190812d89a3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:44.309922 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ea8a586c-7c8d-4532-aae5-e190812d89a3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:44.310377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ea8a586c-7c8d-4532-aae5-e190812d89a3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:44.311160 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ea8a586c-7c8d-4532-aae5-e190812d89a3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:44.311596 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ea8a586c-7c8d-4532-aae5-e190812d89a3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:44.393379 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4fc21939-5eaa-4df5-963b-b59f9dedf0b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:44.407263 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4fc21939-5eaa-4df5-963b-b59f9dedf0b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:44.446878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4fc21939-5eaa-4df5-963b-b59f9dedf0b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:44.446878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4fc21939-5eaa-4df5-963b-b59f9dedf0b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:44.446878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4fc21939-5eaa-4df5-963b-b59f9dedf0b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:44.449544 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4fc21939-5eaa-4df5-963b-b59f9dedf0b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:44.522807 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ea8a586c-7c8d-4532-aae5-e190812d89a3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:44.531760 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ea8a586c-7c8d-4532-aae5-e190812d89a3 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1674 microversion: 2.1 time: 0.236891 Aug 01 14:27:44.533156 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 400/785] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:44 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1674 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:44.643560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4fc21939-5eaa-4df5-963b-b59f9dedf0b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:44.652225 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4fc21939-5eaa-4df5-963b-b59f9dedf0b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:44.653700 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4fc21939-5eaa-4df5-963b-b59f9dedf0b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:44.654905 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4fc21939-5eaa-4df5-963b-b59f9dedf0b3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.275149 Aug 01 14:27:44.655795 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 386/786] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:44 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:27:45.122779 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-9e2c6b0c-d0ae-4c7a-863b-68f4fb029e13 req-defda8e0-15f8-4198-a6e5-4d9d25df9129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769a38d5-5ba3-41fd-b56b-eb5a2081bb11", "name": "network-vif-deleted", "tag": "2334a6a5-d2f6-461e-a84a-258925a8b08c"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:45.143405 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-9e2c6b0c-d0ae-4c7a-863b-68f4fb029e13 req-defda8e0-15f8-4198-a6e5-4d9d25df9129 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:45.143953 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-9e2c6b0c-d0ae-4c7a-863b-68f4fb029e13 req-defda8e0-15f8-4198-a6e5-4d9d25df9129 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:45.159173 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-9e2c6b0c-d0ae-4c7a-863b-68f4fb029e13 req-defda8e0-15f8-4198-a6e5-4d9d25df9129 service nova] Creating event network-vif-deleted:2334a6a5-d2f6-461e-a84a-258925a8b08c for instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 on hv-cinder-78729 Aug 01 14:27:45.165781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-9e2c6b0c-d0ae-4c7a-863b-68f4fb029e13 req-defda8e0-15f8-4198-a6e5-4d9d25df9129 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046747 Aug 01 14:27:45.172414 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 401/787] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:45.555717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ec484463-deb4-4ae7-95ae-39bf1ec56858 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:45.556625 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ec484463-deb4-4ae7-95ae-39bf1ec56858 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:45.564982 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ec484463-deb4-4ae7-95ae-39bf1ec56858 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:45.565508 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ec484463-deb4-4ae7-95ae-39bf1ec56858 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:45.567358 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ec484463-deb4-4ae7-95ae-39bf1ec56858 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:45.568208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ec484463-deb4-4ae7-95ae-39bf1ec56858 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:45.659382 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ec484463-deb4-4ae7-95ae-39bf1ec56858 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:45.676166 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ec484463-deb4-4ae7-95ae-39bf1ec56858 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1607 microversion: 2.1 time: 0.125487 Aug 01 14:27:45.676758 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 387/788] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:45 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1607 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:45.680373 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-9b80423d-7675-4d6c-92ab-9b6061127311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:45.681777 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-9b80423d-7675-4d6c-92ab-9b6061127311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:45.691406 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9b80423d-7675-4d6c-92ab-9b6061127311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:45.693246 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9b80423d-7675-4d6c-92ab-9b6061127311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:45.694289 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9b80423d-7675-4d6c-92ab-9b6061127311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:45.694673 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9b80423d-7675-4d6c-92ab-9b6061127311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:46.241822 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-9b80423d-7675-4d6c-92ab-9b6061127311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:46.253239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-9b80423d-7675-4d6c-92ab-9b6061127311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:46.260343 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-9b80423d-7675-4d6c-92ab-9b6061127311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:46.262227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-9b80423d-7675-4d6c-92ab-9b6061127311 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1731 microversion: 2.20 time: 0.587665 Aug 01 14:27:46.263366 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 402/789] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:45 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1731 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:46.699706 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-183385f7-41a7-49c2-9996-d4fc11ea6a2f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:46.700318 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-183385f7-41a7-49c2-9996-d4fc11ea6a2f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:46.709304 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-183385f7-41a7-49c2-9996-d4fc11ea6a2f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:46.710022 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-183385f7-41a7-49c2-9996-d4fc11ea6a2f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:46.710831 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-183385f7-41a7-49c2-9996-d4fc11ea6a2f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:46.711275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-183385f7-41a7-49c2-9996-d4fc11ea6a2f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:46.716188 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:46.745944 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-183385f7-41a7-49c2-9996-d4fc11ea6a2f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:46.746758 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-183385f7-41a7-49c2-9996-d4fc11ea6a2f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:46.747453 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-183385f7-41a7-49c2-9996-d4fc11ea6a2f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lazy-loading 'fault' on Instance uuid 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:27:46.796271 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-183385f7-41a7-49c2-9996-d4fc11ea6a2f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da4644803547869a303a039ee7a28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7ea2daaa864df7973b21d1d13ae47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:46.804977 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-183385f7-41a7-49c2-9996-d4fc11ea6a2f tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 200 len: 1327 microversion: 2.1 time: 0.109103 Aug 01 14:27:46.805562 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 388/790] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:46 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:27:47.286747 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3d1af25c-be11-4ad9-9861-d93da2a9582c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:47.287332 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3d1af25c-be11-4ad9-9861-d93da2a9582c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:47.290117 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:47.294995 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3d1af25c-be11-4ad9-9861-d93da2a9582c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:47.295457 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3d1af25c-be11-4ad9-9861-d93da2a9582c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:47.296234 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3d1af25c-be11-4ad9-9861-d93da2a9582c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:47.296875 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3d1af25c-be11-4ad9-9861-d93da2a9582c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:47.545201 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3d1af25c-be11-4ad9-9861-d93da2a9582c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:47.554975 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3d1af25c-be11-4ad9-9861-d93da2a9582c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:47.556475 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3d1af25c-be11-4ad9-9861-d93da2a9582c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:27:47.558869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3d1af25c-be11-4ad9-9861-d93da2a9582c tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1718 microversion: 2.20 time: 0.276762 Aug 01 14:27:47.559350 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 403/791] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:27:47 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1718 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:27:47.829254 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f515edfe-8fdd-46b2-882d-36e0877a08bb tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:47.829883 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f515edfe-8fdd-46b2-882d-36e0877a08bb tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:47.838755 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f515edfe-8fdd-46b2-882d-36e0877a08bb tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:47.840223 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f515edfe-8fdd-46b2-882d-36e0877a08bb tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:47.841149 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f515edfe-8fdd-46b2-882d-36e0877a08bb tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:47.841266 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f515edfe-8fdd-46b2-882d-36e0877a08bb tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:47.857895 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-f515edfe-8fdd-46b2-882d-36e0877a08bb tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] HTTP exception thrown: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f515edfe-8fdd-46b2-882d-36e0877a08bb tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Request method failure captured: Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 HTTP/1.1 Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-E5gDnLDrW6jn471VQH6hRhWTkgL7UmqMzqse6VaAIspmL-Ep7LFUyMz4cB_jTfmGhl_A4SC4KvftD9rSHBjjlz0uvS3Q5_6SAeNe5cAmREpguhoLj1hhIs9NmEM_J9PJzDJR8JmMOcx0zWYTZSi92szh8aXrQm6XPEuV2iWtyO_N8 Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: 3f7ea2daaa864df7973b21d1d13ae47a Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:27:47.859651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:27:47.861857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:27:47.861857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:27:47.861857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: 3f7ea2daaa864df7973b21d1d13ae47a Aug 01 14:27:47.861857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:27:47.861857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-AttachVolumeTestJSON-218155940-project Aug 01 14:27:47.861857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:27:47.861857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:27:47.861857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: 47da4644803547869a303a039ee7a28c Aug 01 14:27:47.861857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-AttachVolumeTestJSON-218155940-project Aug 01 14:27:47.861857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:27:47.861857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. Aug 01 14:27:47.861857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': '769a38d5-5ba3-41fd-b56b-eb5a2081bb11'} Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:47.862806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. Aug 01 14:27:47.864392 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:27:47.867005 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f515edfe-8fdd-46b2-882d-36e0877a08bb tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Returning 404 to user: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:47.868906 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f515edfe-8fdd-46b2-882d-36e0877a08bb tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 404 len: 111 microversion: 2.1 time: 0.044080 Aug 01 14:27:47.870024 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 389/792] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:47 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:27:47.880565 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4cf880c7-c371-413c-8f99-e4941e94a2e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '.version_select at 0x7fb24f74b0d0>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:47.996208 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4cf880c7-c371-413c-8f99-e4941e94a2e4 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-855277406" status: 202 len: 0 microversion: 2.1 time: 0.120862 Aug 01 14:27:47.997473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 404/793] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Aug 1 14:27:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-855277406 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:27:51.791215 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-11af7d5b-f3fc-41a8-8b1c-813488d51790 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Action: 'create', calling method: .version_select at 0x7fb24eebeaf0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-544331128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyU9KcujXZOnSxjVVYFYs2mhlsX0g9dGiVuQsEQPbir+6uY3z41zWxRFfW40Zp92rxIDITmopATAMAp765996UQVjQ5YtvAVfK8KHrq9R1sylmuyd5EkUoZP8IOvhJiVA=="}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:27:51.796710 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:51.811840 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-11af7d5b-f3fc-41a8-8b1c-813488d51790 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Getting quotas for project 1d34ed67668c475695dbd57530aa6d49. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:27:51.817085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-11af7d5b-f3fc-41a8-8b1c-813488d51790 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Getting quotas for user cc8d9f649a43450da28c0f7c2e4515ec and project 1d34ed67668c475695dbd57530aa6d49. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:27:51.841297 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-cf991161-9971-4eba-bd86-f7f373cf7b14 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:51.848277 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-cf991161-9971-4eba-bd86-f7f373cf7b14 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:51.849160 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cf991161-9971-4eba-bd86-f7f373cf7b14 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:51.849160 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cf991161-9971-4eba-bd86-f7f373cf7b14 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:51.849784 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cf991161-9971-4eba-bd86-f7f373cf7b14 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:51.850251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cf991161-9971-4eba-bd86-f7f373cf7b14 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:51.864936 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-cf991161-9971-4eba-bd86-f7f373cf7b14 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] HTTP exception thrown: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-cf991161-9971-4eba-bd86-f7f373cf7b14 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Request method failure captured: Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: DELETE /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 HTTP/1.1 Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-E5gDnLDrW6jn471VQH6hRhWTkgL7UmqMzqse6VaAIspmL-Ep7LFUyMz4cB_jTfmGhl_A4SC4KvftD9rSHBjjlz0uvS3Q5_6SAeNe5cAmREpguhoLj1hhIs9NmEM_J9PJzDJR8JmMOcx0zWYTZSi92szh8aXrQm6XPEuV2iWtyO_N8 Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: 3f7ea2daaa864df7973b21d1d13ae47a Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:27:51.867085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:27:51.868382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:27:51.868382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:27:51.868382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: 3f7ea2daaa864df7973b21d1d13ae47a Aug 01 14:27:51.868382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:27:51.868382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-AttachVolumeTestJSON-218155940-project Aug 01 14:27:51.868382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:27:51.868382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:27:51.868382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: 47da4644803547869a303a039ee7a28c Aug 01 14:27:51.868382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-AttachVolumeTestJSON-218155940-project Aug 01 14:27:51.868382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:27:51.868382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. Aug 01 14:27:51.868382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '769a38d5-5ba3-41fd-b56b-eb5a2081bb11'} Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:51.869086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. Aug 01 14:27:51.870520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:27:51.872809 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-cf991161-9971-4eba-bd86-f7f373cf7b14 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Returning 404 to user: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:51.872809 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-cf991161-9971-4eba-bd86-f7f373cf7b14 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "DELETE /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 404 len: 111 microversion: 2.1 time: 0.031918 Aug 01 14:27:51.872809 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 405/794] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:27:51 2022] DELETE /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:27:51.877035 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e5457539-2f37-4a8a-84aa-cc0b2b5828ae tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:51.877925 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e5457539-2f37-4a8a-84aa-cc0b2b5828ae tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 769a38d5-5ba3-41fd-b56b-eb5a2081bb11] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:51.884706 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e5457539-2f37-4a8a-84aa-cc0b2b5828ae tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:51.885155 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e5457539-2f37-4a8a-84aa-cc0b2b5828ae tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:51.885952 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e5457539-2f37-4a8a-84aa-cc0b2b5828ae tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:51.886390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e5457539-2f37-4a8a-84aa-cc0b2b5828ae tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:51.906090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-e5457539-2f37-4a8a-84aa-cc0b2b5828ae tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] HTTP exception thrown: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e5457539-2f37-4a8a-84aa-cc0b2b5828ae tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Request method failure captured: Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 HTTP/1.1 Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-E5gDnLDrW6jn471VQH6hRhWTkgL7UmqMzqse6VaAIspmL-Ep7LFUyMz4cB_jTfmGhl_A4SC4KvftD9rSHBjjlz0uvS3Q5_6SAeNe5cAmREpguhoLj1hhIs9NmEM_J9PJzDJR8JmMOcx0zWYTZSi92szh8aXrQm6XPEuV2iWtyO_N8 Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: 3f7ea2daaa864df7973b21d1d13ae47a Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:27:51.911606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:27:51.913197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:27:51.913197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:27:51.913197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: 3f7ea2daaa864df7973b21d1d13ae47a Aug 01 14:27:51.913197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:27:51.913197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-AttachVolumeTestJSON-218155940-project Aug 01 14:27:51.913197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:27:51.913197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:27:51.913197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: 47da4644803547869a303a039ee7a28c Aug 01 14:27:51.913197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-AttachVolumeTestJSON-218155940-project Aug 01 14:27:51.913197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:27:51.913197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. Aug 01 14:27:51.913197 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '769a38d5-5ba3-41fd-b56b-eb5a2081bb11'} Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:51.914222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. Aug 01 14:27:51.915389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:27:51.916514 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e5457539-2f37-4a8a-84aa-cc0b2b5828ae tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Returning 404 to user: Instance 769a38d5-5ba3-41fd-b56b-eb5a2081bb11 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:51.916514 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e5457539-2f37-4a8a-84aa-cc0b2b5828ae tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11" status: 404 len: 111 microversion: 2.1 time: 0.036462 Aug 01 14:27:51.916514 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 406/795] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:51 2022] GET /compute/v2.1/servers/769a38d5-5ba3-41fd-b56b-eb5a2081bb11 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:27:51.933899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-11af7d5b-f3fc-41a8-8b1c-813488d51790 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.320550 Aug 01 14:27:51.934510 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 390/796] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Aug 1 14:27:51 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:27:53.253639 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-2e477dd4-10c7-4f82-b1c9-69a90353f324 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:53.254184 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-2e477dd4-10c7-4f82-b1c9-69a90353f324 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:53.260753 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2e477dd4-10c7-4f82-b1c9-69a90353f324 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:53.261203 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2e477dd4-10c7-4f82-b1c9-69a90353f324 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:53.262033 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2e477dd4-10c7-4f82-b1c9-69a90353f324 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:53.262480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2e477dd4-10c7-4f82-b1c9-69a90353f324 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:53.277455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-2e477dd4-10c7-4f82-b1c9-69a90353f324 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] HTTP exception thrown: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-2e477dd4-10c7-4f82-b1c9-69a90353f324 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Request method failure captured: Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: DELETE /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b HTTP/1.1 Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-E5gDnLDrW6jn471VQH6hRhWTkgL7UmqMzqse6VaAIspmL-Ep7LFUyMz4cB_jTfmGhl_A4SC4KvftD9rSHBjjlz0uvS3Q5_6SAeNe5cAmREpguhoLj1hhIs9NmEM_J9PJzDJR8JmMOcx0zWYTZSi92szh8aXrQm6XPEuV2iWtyO_N8 Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: 3f7ea2daaa864df7973b21d1d13ae47a Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:27:53.278976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:27:53.280474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:27:53.280474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:27:53.280474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: 3f7ea2daaa864df7973b21d1d13ae47a Aug 01 14:27:53.280474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:27:53.280474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-AttachVolumeTestJSON-218155940-project Aug 01 14:27:53.280474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:27:53.280474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:27:53.280474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: 47da4644803547869a303a039ee7a28c Aug 01 14:27:53.280474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-AttachVolumeTestJSON-218155940-project Aug 01 14:27:53.280474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:27:53.280474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. Aug 01 14:27:53.280474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '2eb5f425-d747-41d4-bed5-211a5d80e32b'} Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:53.284752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. Aug 01 14:27:53.286239 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:27:53.287682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-2e477dd4-10c7-4f82-b1c9-69a90353f324 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Returning 404 to user: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:53.287682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-2e477dd4-10c7-4f82-b1c9-69a90353f324 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 404 len: 111 microversion: 2.1 time: 0.031485 Aug 01 14:27:53.287682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 407/797] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:27:53 2022] DELETE /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:27:53.290382 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5a1ccc69-c997-4e35-a1e4-a01ce41c14e5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:27:53.291070 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5a1ccc69-c997-4e35-a1e4-a01ce41c14e5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] [instance: 2eb5f425-d747-41d4-bed5-211a5d80e32b] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:27:53.299207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5a1ccc69-c997-4e35-a1e4-a01ce41c14e5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:53.299664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5a1ccc69-c997-4e35-a1e4-a01ce41c14e5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:53.300440 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5a1ccc69-c997-4e35-a1e4-a01ce41c14e5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:27:53.300884 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5a1ccc69-c997-4e35-a1e4-a01ce41c14e5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:27:53.316795 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-5a1ccc69-c997-4e35-a1e4-a01ce41c14e5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] HTTP exception thrown: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5a1ccc69-c997-4e35-a1e4-a01ce41c14e5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Request method failure captured: Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b HTTP/1.1 Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-E5gDnLDrW6jn471VQH6hRhWTkgL7UmqMzqse6VaAIspmL-Ep7LFUyMz4cB_jTfmGhl_A4SC4KvftD9rSHBjjlz0uvS3Q5_6SAeNe5cAmREpguhoLj1hhIs9NmEM_J9PJzDJR8JmMOcx0zWYTZSi92szh8aXrQm6XPEuV2iWtyO_N8 Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: 3f7ea2daaa864df7973b21d1d13ae47a Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:27:53.320074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:27:53.321693 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3f7ea2daaa864df7973b21d1d13ae47a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:27:53.321693 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:27:53.321693 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: 3f7ea2daaa864df7973b21d1d13ae47a Aug 01 14:27:53.321693 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-AttachVolumeTestJSON-218155940 Aug 01 14:27:53.321693 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-AttachVolumeTestJSON-218155940-project Aug 01 14:27:53.321693 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:27:53.321693 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:27:53.321693 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: 47da4644803547869a303a039ee7a28c Aug 01 14:27:53.321693 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-AttachVolumeTestJSON-218155940-project Aug 01 14:27:53.321693 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:27:53.321693 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. Aug 01 14:27:53.321693 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': '2eb5f425-d747-41d4-bed5-211a5d80e32b'} Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:27:53.322567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. Aug 01 14:27:53.324198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:27:53.325898 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5a1ccc69-c997-4e35-a1e4-a01ce41c14e5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] Returning 404 to user: Instance 2eb5f425-d747-41d4-bed5-211a5d80e32b could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:27:53.325898 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5a1ccc69-c997-4e35-a1e4-a01ce41c14e5 tempest-AttachVolumeTestJSON-218155940 tempest-AttachVolumeTestJSON-218155940-project] 10.222.0.49 "GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b" status: 404 len: 111 microversion: 2.1 time: 0.034266 Aug 01 14:27:53.325898 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 391/798] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:27:53 2022] GET /compute/v2.1/servers/2eb5f425-d747-41d4-bed5-211a5d80e32b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:28:04.803982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:04.805260 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:04.930317 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-cd3956b9-fb01-4783-9bec-970fc3a8de4d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Action: 'create', calling method: .version_select at 0x7fb24f7b64c0>, body: {"keypair": {"name": "tempest-keypair-1714862031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME57CHUK0ZiwD5LJJfrRS/TX2IRFhkBhN2tcvV2KSHX169C3XD6qVBikTB0CuXZuPSqARQWpRRze0MUsgXk3Zj6SmYANZ2uRuHbIvZWB+h94OFFOt/5wl06CHx5wORrdQ=="}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:04.947328 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-cd3956b9-fb01-4783-9bec-970fc3a8de4d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Getting quotas for project c6df4baf0a1242f2b73fe99071682355. Resources: {'key_pairs'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:28:04.951519 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-cd3956b9-fb01-4783-9bec-970fc3a8de4d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Getting quotas for user fbb29845a13844f89fd004b401d27b8e and project c6df4baf0a1242f2b73fe99071682355. Resources: {'key_pairs'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:28:05.034567 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-cd3956b9-fb01-4783-9bec-970fc3a8de4d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.235881 Aug 01 14:28:05.035203 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 408/799] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Aug 1 14:28:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:28:07.334060 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-40243af3-1e6f-4dac-80d9-63a33e9d236b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1580829233", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34cc3867-be64-4b6c-a790-8e0e66fb7fc3"}], "security_groups": [{"name": "tempest-securitygroup--1157172324"}], "key_name": "tempest-keypair-1714862031", "user_data": "}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:07.342306 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=4 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:07.343074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=10 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:07.442482 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.network.neutron [None req-40243af3-1e6f-4dac-80d9-63a33e9d236b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] validate_networks() for [('34cc3867-be64-4b6c-a790-8e0e66fb7fc3', None, None, None, None, None)] {{(pid=118246) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:28:07.842014 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-40243af3-1e6f-4dac-80d9-63a33e9d236b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Flavor limits 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:28:07.842439 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-40243af3-1e6f-4dac-80d9-63a33e9d236b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Image limits 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:28:07.843010 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-40243af3-1e6f-4dac-80d9-63a33e9d236b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Flavor pref 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:28:07.843478 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-40243af3-1e6f-4dac-80d9-63a33e9d236b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Image pref 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:28:07.843887 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-40243af3-1e6f-4dac-80d9-63a33e9d236b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:28:07.853610 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-40243af3-1e6f-4dac-80d9-63a33e9d236b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:07.854084 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-40243af3-1e6f-4dac-80d9-63a33e9d236b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:07.854885 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-40243af3-1e6f-4dac-80d9-63a33e9d236b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:07.855316 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-40243af3-1e6f-4dac-80d9-63a33e9d236b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:07.873595 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-40243af3-1e6f-4dac-80d9-63a33e9d236b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Getting quotas for project c6df4baf0a1242f2b73fe99071682355. Resources: {'ram', 'cores', 'instances'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:28:07.877963 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-40243af3-1e6f-4dac-80d9-63a33e9d236b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Getting quotas for user fbb29845a13844f89fd004b401d27b8e and project c6df4baf0a1242f2b73fe99071682355. Resources: {'ram', 'cores', 'instances'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:28:07.893263 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-40243af3-1e6f-4dac-80d9-63a33e9d236b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Going to run 1 instances... {{(pid=118246) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:28:07.895770 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-40243af3-1e6f-4dac-80d9-63a33e9d236b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118246) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:28:08.026212 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-40243af3-1e6f-4dac-80d9-63a33e9d236b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.696952 Aug 01 14:28:08.027176 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 392/800] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:28:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:28:08.038859 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-428eca81-4ba3-4ec1-9952-3018264fcfa4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:08.039615 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-428eca81-4ba3-4ec1-9952-3018264fcfa4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:08.128969 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-428eca81-4ba3-4ec1-9952-3018264fcfa4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:08.136253 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-428eca81-4ba3-4ec1-9952-3018264fcfa4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 200 len: 1242 microversion: 2.1 time: 0.101752 Aug 01 14:28:08.139754 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 409/801] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:08 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:09.158921 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ba6ce9de-361b-4e76-9759-de2519bb0248 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:09.159494 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ba6ce9de-361b-4e76-9759-de2519bb0248 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:09.165745 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ba6ce9de-361b-4e76-9759-de2519bb0248 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:09.166231 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ba6ce9de-361b-4e76-9759-de2519bb0248 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:09.167010 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ba6ce9de-361b-4e76-9759-de2519bb0248 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:09.167453 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ba6ce9de-361b-4e76-9759-de2519bb0248 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:09.228391 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ba6ce9de-361b-4e76-9759-de2519bb0248 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:09.236638 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ba6ce9de-361b-4e76-9759-de2519bb0248 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 200 len: 1246 microversion: 2.1 time: 0.082864 Aug 01 14:28:09.237225 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 393/802] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:09 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:10.257559 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6b6c7182-1023-4db3-8f6c-5317c812e165 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:10.258837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-6b6c7182-1023-4db3-8f6c-5317c812e165 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:10.267120 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6b6c7182-1023-4db3-8f6c-5317c812e165 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:10.267653 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6b6c7182-1023-4db3-8f6c-5317c812e165 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:10.268438 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6b6c7182-1023-4db3-8f6c-5317c812e165 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:10.268876 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6b6c7182-1023-4db3-8f6c-5317c812e165 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:10.345117 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6b6c7182-1023-4db3-8f6c-5317c812e165 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:10.354392 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-6b6c7182-1023-4db3-8f6c-5317c812e165 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 200 len: 1302 microversion: 2.1 time: 0.100635 Aug 01 14:28:10.354947 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 410/803] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:10 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 1302 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:11.378281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-788564a2-864c-4581-9077-d3a502fea554 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:11.378963 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-788564a2-864c-4581-9077-d3a502fea554 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:11.386448 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-788564a2-864c-4581-9077-d3a502fea554 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:11.387303 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-788564a2-864c-4581-9077-d3a502fea554 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:11.388412 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-788564a2-864c-4581-9077-d3a502fea554 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:11.389106 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-788564a2-864c-4581-9077-d3a502fea554 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:11.588522 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a2d4aacc-0298-4c52-af33-baae27d1c1bb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1161340941", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-544331128", "security_groups": [{"name": "tempest-secgroup-smoke-1690971366"}], "block_device_mapping_v2": [{"uuid": "635ed620-8d76-4f88-bf8c-e900f22c77b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "30f01bf7-4722-4776-930d-9ee72a3389f9"}]}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:11.772844 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.network.neutron [None req-a2d4aacc-0298-4c52-af33-baae27d1c1bb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] validate_networks() for [('30f01bf7-4722-4776-930d-9ee72a3389f9', None, None, None, None, None)] {{(pid=118247) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:28:11.817871 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-788564a2-864c-4581-9077-d3a502fea554 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:11.825844 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-788564a2-864c-4581-9077-d3a502fea554 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 200 len: 1368 microversion: 2.1 time: 0.452676 Aug 01 14:28:11.826415 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 394/804] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:11 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 1368 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:12.002111 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-62b4179f-aeb4-4606-b641-5ab2b969cc23 req-666702a6-8f47-461f-8d49-7ead9cb93471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3117aae-0e0a-491a-aa97-8aa3f63615df", "tag": "0ab1f378-12d0-4be5-9948-e3cb682adb00"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:12.013743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-62b4179f-aeb4-4606-b641-5ab2b969cc23 req-666702a6-8f47-461f-8d49-7ead9cb93471 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:12.014421 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-62b4179f-aeb4-4606-b641-5ab2b969cc23 req-666702a6-8f47-461f-8d49-7ead9cb93471 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:12.026550 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-62b4179f-aeb4-4606-b641-5ab2b969cc23 req-666702a6-8f47-461f-8d49-7ead9cb93471 service nova] Creating event network-changed:0ab1f378-12d0-4be5-9948-e3cb682adb00 for instance f3117aae-0e0a-491a-aa97-8aa3f63615df on hv-cinder-78729 Aug 01 14:28:12.032889 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-62b4179f-aeb4-4606-b641-5ab2b969cc23 req-666702a6-8f47-461f-8d49-7ead9cb93471 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040029 Aug 01 14:28:12.033896 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 395/805] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:12.178315 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-a2d4aacc-0298-4c52-af33-baae27d1c1bb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Flavor limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:28:12.178742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-a2d4aacc-0298-4c52-af33-baae27d1c1bb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Image limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:28:12.179214 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-a2d4aacc-0298-4c52-af33-baae27d1c1bb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Flavor pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:28:12.179622 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-a2d4aacc-0298-4c52-af33-baae27d1c1bb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Image pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:28:12.180037 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-a2d4aacc-0298-4c52-af33-baae27d1c1bb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:28:12.189281 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a2d4aacc-0298-4c52-af33-baae27d1c1bb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:12.189721 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a2d4aacc-0298-4c52-af33-baae27d1c1bb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:12.190550 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a2d4aacc-0298-4c52-af33-baae27d1c1bb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:12.191255 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a2d4aacc-0298-4c52-af33-baae27d1c1bb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:12.207856 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-a2d4aacc-0298-4c52-af33-baae27d1c1bb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Getting quotas for project 1d34ed67668c475695dbd57530aa6d49. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:28:12.211840 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-a2d4aacc-0298-4c52-af33-baae27d1c1bb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Getting quotas for user cc8d9f649a43450da28c0f7c2e4515ec and project 1d34ed67668c475695dbd57530aa6d49. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:28:12.269193 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a2d4aacc-0298-4c52-af33-baae27d1c1bb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Going to run 1 instances... {{(pid=118247) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:28:12.271277 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a2d4aacc-0298-4c52-af33-baae27d1c1bb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='635ed620-8d76-4f88-bf8c-e900f22c77b1',volume_size=None,volume_type=None)] {{(pid=118247) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:28:12.765047 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a2d4aacc-0298-4c52-af33-baae27d1c1bb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.180873 Aug 01 14:28:12.772706 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 411/806] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:28:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:28:12.778675 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-58f1110a-13a2-49c0-b339-e599097666d6 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:12.779512 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-58f1110a-13a2-49c0-b339-e599097666d6 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:12.841515 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-58f1110a-13a2-49c0-b339-e599097666d6 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:12.848492 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-12fdeee1-bd1f-430b-b962-c124e331053e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:12.848935 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-58f1110a-13a2-49c0-b339-e599097666d6 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1094 microversion: 2.1 time: 0.074730 Aug 01 14:28:12.849432 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-12fdeee1-bd1f-430b-b962-c124e331053e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:12.857894 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-12fdeee1-bd1f-430b-b962-c124e331053e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:12.858435 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-12fdeee1-bd1f-430b-b962-c124e331053e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:12.859497 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-12fdeee1-bd1f-430b-b962-c124e331053e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:12.860032 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-12fdeee1-bd1f-430b-b962-c124e331053e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:12.862699 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 396/807] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:12 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1094 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:12.995263 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-12fdeee1-bd1f-430b-b962-c124e331053e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:13.003470 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-12fdeee1-bd1f-430b-b962-c124e331053e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 200 len: 1368 microversion: 2.1 time: 0.159325 Aug 01 14:28:13.004043 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 412/808] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:12 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:13.869996 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8ecc049c-111a-47fe-8c72-067764a696e9 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:13.870399 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8ecc049c-111a-47fe-8c72-067764a696e9 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:13.880991 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8ecc049c-111a-47fe-8c72-067764a696e9 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:13.881444 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8ecc049c-111a-47fe-8c72-067764a696e9 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:13.882267 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8ecc049c-111a-47fe-8c72-067764a696e9 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:13.882680 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8ecc049c-111a-47fe-8c72-067764a696e9 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:13.945021 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8ecc049c-111a-47fe-8c72-067764a696e9 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:13.952682 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8ecc049c-111a-47fe-8c72-067764a696e9 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1144 microversion: 2.1 time: 0.087009 Aug 01 14:28:13.953281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 397/809] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:13 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:14.025360 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-8534cd33-08f7-450a-a80f-3195b19e3ca1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:14.027143 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-8534cd33-08f7-450a-a80f-3195b19e3ca1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:14.034741 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8534cd33-08f7-450a-a80f-3195b19e3ca1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:14.035193 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8534cd33-08f7-450a-a80f-3195b19e3ca1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:14.035965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8534cd33-08f7-450a-a80f-3195b19e3ca1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:14.036401 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8534cd33-08f7-450a-a80f-3195b19e3ca1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:14.176498 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-8534cd33-08f7-450a-a80f-3195b19e3ca1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:14.183945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-8534cd33-08f7-450a-a80f-3195b19e3ca1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 200 len: 1368 microversion: 2.1 time: 0.162839 Aug 01 14:28:14.184572 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 413/810] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:14 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:14.974972 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5b852102-38aa-4a4c-8047-a340f29c8fb1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:14.975505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5b852102-38aa-4a4c-8047-a340f29c8fb1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:14.983645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5b852102-38aa-4a4c-8047-a340f29c8fb1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:14.984453 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5b852102-38aa-4a4c-8047-a340f29c8fb1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:14.986422 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5b852102-38aa-4a4c-8047-a340f29c8fb1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:14.986862 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5b852102-38aa-4a4c-8047-a340f29c8fb1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:15.051783 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-5b852102-38aa-4a4c-8047-a340f29c8fb1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:15.059483 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5b852102-38aa-4a4c-8047-a340f29c8fb1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1200 microversion: 2.1 time: 0.088492 Aug 01 14:28:15.060056 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 398/811] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:14 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1200 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:15.206552 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ed485e07-7dab-430c-a96c-1d6562ad5521 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:15.212638 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ed485e07-7dab-430c-a96c-1d6562ad5521 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:15.214697 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ed485e07-7dab-430c-a96c-1d6562ad5521 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:15.215145 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ed485e07-7dab-430c-a96c-1d6562ad5521 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:15.215917 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ed485e07-7dab-430c-a96c-1d6562ad5521 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:15.216350 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ed485e07-7dab-430c-a96c-1d6562ad5521 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:15.350030 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ed485e07-7dab-430c-a96c-1d6562ad5521 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:15.358221 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ed485e07-7dab-430c-a96c-1d6562ad5521 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 200 len: 1368 microversion: 2.1 time: 0.156923 Aug 01 14:28:15.358789 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 414/812] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:15 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:16.080917 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-93044b6b-a75b-4eeb-99df-0754d62bc8b4 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:16.082198 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-93044b6b-a75b-4eeb-99df-0754d62bc8b4 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:16.088947 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-93044b6b-a75b-4eeb-99df-0754d62bc8b4 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:16.089639 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-93044b6b-a75b-4eeb-99df-0754d62bc8b4 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:16.090462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-93044b6b-a75b-4eeb-99df-0754d62bc8b4 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:16.090902 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-93044b6b-a75b-4eeb-99df-0754d62bc8b4 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:16.235689 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-93044b6b-a75b-4eeb-99df-0754d62bc8b4 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:16.243991 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-93044b6b-a75b-4eeb-99df-0754d62bc8b4 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1278 microversion: 2.1 time: 0.167250 Aug 01 14:28:16.244824 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 399/813] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:16 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:16.380352 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7645fc6d-24a1-43fa-a2e9-8bb420a1012b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:16.381833 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7645fc6d-24a1-43fa-a2e9-8bb420a1012b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:16.388305 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7645fc6d-24a1-43fa-a2e9-8bb420a1012b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:16.388853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7645fc6d-24a1-43fa-a2e9-8bb420a1012b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:16.389697 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7645fc6d-24a1-43fa-a2e9-8bb420a1012b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:16.390243 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7645fc6d-24a1-43fa-a2e9-8bb420a1012b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:16.529070 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7645fc6d-24a1-43fa-a2e9-8bb420a1012b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:16.538875 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7645fc6d-24a1-43fa-a2e9-8bb420a1012b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 200 len: 1368 microversion: 2.1 time: 0.163158 Aug 01 14:28:16.540300 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 415/814] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:16 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:16.665701 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-57fdf27b-c3c8-4efd-baa6-77ceac09754a req-dc2b09d9-d3bf-47e6-a2a4-dd1d8281d206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a377af0-0542-410e-93c3-e8c076f16ce6", "tag": "416f1933-aa1d-4746-9f1f-44a8878036a3"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:16.676387 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-57fdf27b-c3c8-4efd-baa6-77ceac09754a req-dc2b09d9-d3bf-47e6-a2a4-dd1d8281d206 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:16.677113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-57fdf27b-c3c8-4efd-baa6-77ceac09754a req-dc2b09d9-d3bf-47e6-a2a4-dd1d8281d206 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:16.688958 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-57fdf27b-c3c8-4efd-baa6-77ceac09754a req-dc2b09d9-d3bf-47e6-a2a4-dd1d8281d206 service nova] Creating event network-changed:416f1933-aa1d-4746-9f1f-44a8878036a3 for instance 6a377af0-0542-410e-93c3-e8c076f16ce6 on hv-cinder-78729 Aug 01 14:28:16.694356 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-57fdf27b-c3c8-4efd-baa6-77ceac09754a req-dc2b09d9-d3bf-47e6-a2a4-dd1d8281d206 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032065 Aug 01 14:28:16.695374 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 400/815] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:17.267088 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-9382a948-602b-479d-8dc4-63a706384b7d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:17.268064 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-9382a948-602b-479d-8dc4-63a706384b7d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:17.274178 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9382a948-602b-479d-8dc4-63a706384b7d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:17.274755 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9382a948-602b-479d-8dc4-63a706384b7d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:17.275556 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9382a948-602b-479d-8dc4-63a706384b7d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:17.275990 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9382a948-602b-479d-8dc4-63a706384b7d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:17.411699 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-9382a948-602b-479d-8dc4-63a706384b7d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:17.419474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-9382a948-602b-479d-8dc4-63a706384b7d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1266 microversion: 2.1 time: 0.157120 Aug 01 14:28:17.420041 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 416/816] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:17 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:17.561521 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b2a58f15-ce45-4b67-a25d-c164884867d4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:17.562230 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b2a58f15-ce45-4b67-a25d-c164884867d4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:17.569294 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b2a58f15-ce45-4b67-a25d-c164884867d4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:17.569745 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b2a58f15-ce45-4b67-a25d-c164884867d4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:17.570541 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b2a58f15-ce45-4b67-a25d-c164884867d4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:17.570978 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b2a58f15-ce45-4b67-a25d-c164884867d4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:17.699853 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-b2a58f15-ce45-4b67-a25d-c164884867d4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:17.707538 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b2a58f15-ce45-4b67-a25d-c164884867d4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 200 len: 1368 microversion: 2.1 time: 0.150728 Aug 01 14:28:17.708097 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 401/817] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:17 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:18.440519 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d0ca84f0-092f-45dd-a7e7-c1a3f50780d2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:18.441146 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d0ca84f0-092f-45dd-a7e7-c1a3f50780d2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:18.447708 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d0ca84f0-092f-45dd-a7e7-c1a3f50780d2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:18.448160 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d0ca84f0-092f-45dd-a7e7-c1a3f50780d2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:18.448938 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d0ca84f0-092f-45dd-a7e7-c1a3f50780d2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:18.449470 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d0ca84f0-092f-45dd-a7e7-c1a3f50780d2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:18.581259 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d0ca84f0-092f-45dd-a7e7-c1a3f50780d2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:18.588736 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d0ca84f0-092f-45dd-a7e7-c1a3f50780d2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1266 microversion: 2.1 time: 0.152206 Aug 01 14:28:18.589299 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 417/818] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:18 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:18.732465 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c115b3b6-f01d-4f6c-8b9c-60f70522e99d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:18.733078 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c115b3b6-f01d-4f6c-8b9c-60f70522e99d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:18.735227 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=2 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:18.741037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c115b3b6-f01d-4f6c-8b9c-60f70522e99d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:18.741491 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c115b3b6-f01d-4f6c-8b9c-60f70522e99d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:18.743726 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c115b3b6-f01d-4f6c-8b9c-60f70522e99d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:18.743726 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c115b3b6-f01d-4f6c-8b9c-60f70522e99d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:18.788289 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-6a150acb-5599-4a8c-a0d2-5b7ce34dedbf req-ac615194-0894-41db-9b3f-c1e617a936f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3117aae-0e0a-491a-aa97-8aa3f63615df", "name": "network-vif-plugged", "status": "completed", "tag": "0ab1f378-12d0-4be5-9948-e3cb682adb00"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:18.797890 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-6a150acb-5599-4a8c-a0d2-5b7ce34dedbf req-ac615194-0894-41db-9b3f-c1e617a936f2 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:18.798395 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-6a150acb-5599-4a8c-a0d2-5b7ce34dedbf req-ac615194-0894-41db-9b3f-c1e617a936f2 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:18.809993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-6a150acb-5599-4a8c-a0d2-5b7ce34dedbf req-ac615194-0894-41db-9b3f-c1e617a936f2 service nova] Creating event network-vif-plugged:0ab1f378-12d0-4be5-9948-e3cb682adb00 for instance f3117aae-0e0a-491a-aa97-8aa3f63615df on hv-cinder-78729 Aug 01 14:28:18.816164 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-6a150acb-5599-4a8c-a0d2-5b7ce34dedbf req-ac615194-0894-41db-9b3f-c1e617a936f2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031486 Aug 01 14:28:18.821229 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 418/819] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:28:18.890559 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c115b3b6-f01d-4f6c-8b9c-60f70522e99d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:18.898141 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c115b3b6-f01d-4f6c-8b9c-60f70522e99d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 200 len: 1368 microversion: 2.1 time: 0.169522 Aug 01 14:28:18.912882 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 402/820] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:18 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:19.610572 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-9d82c5e0-ecca-4494-b9c7-0a1d5f42382b tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:19.611274 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-9d82c5e0-ecca-4494-b9c7-0a1d5f42382b tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:19.618799 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9d82c5e0-ecca-4494-b9c7-0a1d5f42382b tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:19.619248 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9d82c5e0-ecca-4494-b9c7-0a1d5f42382b tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:19.620013 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9d82c5e0-ecca-4494-b9c7-0a1d5f42382b tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:19.620447 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9d82c5e0-ecca-4494-b9c7-0a1d5f42382b tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:19.753912 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-9d82c5e0-ecca-4494-b9c7-0a1d5f42382b tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:19.761723 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-9d82c5e0-ecca-4494-b9c7-0a1d5f42382b tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1266 microversion: 2.1 time: 0.155536 Aug 01 14:28:19.762323 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 419/821] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:19 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:19.918844 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1f29fe55-c60d-4fdb-8dce-8e7a02be5ee1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:19.919459 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-1f29fe55-c60d-4fdb-8dce-8e7a02be5ee1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:19.926550 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1f29fe55-c60d-4fdb-8dce-8e7a02be5ee1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:19.927004 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1f29fe55-c60d-4fdb-8dce-8e7a02be5ee1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:19.927766 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1f29fe55-c60d-4fdb-8dce-8e7a02be5ee1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:19.928227 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1f29fe55-c60d-4fdb-8dce-8e7a02be5ee1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:20.061489 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-1f29fe55-c60d-4fdb-8dce-8e7a02be5ee1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:20.069680 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-1f29fe55-c60d-4fdb-8dce-8e7a02be5ee1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 200 len: 1368 microversion: 2.1 time: 0.154729 Aug 01 14:28:20.070295 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 403/822] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:19 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:20.784519 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7cbca790-e79f-4461-bc06-2cd7f0082c5f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:20.785134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7cbca790-e79f-4461-bc06-2cd7f0082c5f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:20.791830 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7cbca790-e79f-4461-bc06-2cd7f0082c5f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:20.792278 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7cbca790-e79f-4461-bc06-2cd7f0082c5f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:20.793057 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7cbca790-e79f-4461-bc06-2cd7f0082c5f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:20.793499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7cbca790-e79f-4461-bc06-2cd7f0082c5f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:20.925764 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7cbca790-e79f-4461-bc06-2cd7f0082c5f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:20.933728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7cbca790-e79f-4461-bc06-2cd7f0082c5f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1266 microversion: 2.1 time: 0.154337 Aug 01 14:28:20.934321 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 420/823] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:20 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:28:21.089601 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8a709a6e-075e-4dac-a63f-dff019721070 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:21.090239 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8a709a6e-075e-4dac-a63f-dff019721070 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:21.096732 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8a709a6e-075e-4dac-a63f-dff019721070 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:21.097184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8a709a6e-075e-4dac-a63f-dff019721070 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:21.097976 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8a709a6e-075e-4dac-a63f-dff019721070 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:21.098411 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8a709a6e-075e-4dac-a63f-dff019721070 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:21.233294 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8a709a6e-075e-4dac-a63f-dff019721070 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:21.241136 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8a709a6e-075e-4dac-a63f-dff019721070 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 200 len: 1558 microversion: 2.1 time: 0.155419 Aug 01 14:28:21.241697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 404/824] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:21 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:21.261779 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d99d5aa2-eaaa-417e-92c1-c54b87730fa8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:21.262282 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d99d5aa2-eaaa-417e-92c1-c54b87730fa8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:21.268870 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d99d5aa2-eaaa-417e-92c1-c54b87730fa8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:21.269331 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d99d5aa2-eaaa-417e-92c1-c54b87730fa8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:21.270129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d99d5aa2-eaaa-417e-92c1-c54b87730fa8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:21.270569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d99d5aa2-eaaa-417e-92c1-c54b87730fa8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:21.345664 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d99d5aa2-eaaa-417e-92c1-c54b87730fa8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087664 Aug 01 14:28:21.346317 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 421/825] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Aug 1 14:28:21 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:21.955547 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d7e61ac1-281c-4b15-b6fd-c423d0135fc1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:21.956184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d7e61ac1-281c-4b15-b6fd-c423d0135fc1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:21.962780 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d7e61ac1-281c-4b15-b6fd-c423d0135fc1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:21.963230 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d7e61ac1-281c-4b15-b6fd-c423d0135fc1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:21.964002 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d7e61ac1-281c-4b15-b6fd-c423d0135fc1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:21.964439 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d7e61ac1-281c-4b15-b6fd-c423d0135fc1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:22.178270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d7e61ac1-281c-4b15-b6fd-c423d0135fc1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:22.185747 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d7e61ac1-281c-4b15-b6fd-c423d0135fc1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1266 microversion: 2.1 time: 0.234218 Aug 01 14:28:22.186342 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 405/826] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:21 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:22.421868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=2 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:22.423852 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=12 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:22.426742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-00f9e421-292d-4690-85e5-0ec46bcf8ba7 req-6765182d-86fc-449e-9150-06a477bf9bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3117aae-0e0a-491a-aa97-8aa3f63615df", "tag": "0ab1f378-12d0-4be5-9948-e3cb682adb00"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:22.435970 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-00f9e421-292d-4690-85e5-0ec46bcf8ba7 req-6765182d-86fc-449e-9150-06a477bf9bd0 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:22.436418 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-00f9e421-292d-4690-85e5-0ec46bcf8ba7 req-6765182d-86fc-449e-9150-06a477bf9bd0 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:22.449058 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-00f9e421-292d-4690-85e5-0ec46bcf8ba7 req-6765182d-86fc-449e-9150-06a477bf9bd0 service nova] Creating event network-changed:0ab1f378-12d0-4be5-9948-e3cb682adb00 for instance f3117aae-0e0a-491a-aa97-8aa3f63615df on hv-cinder-78729 Aug 01 14:28:22.454872 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-00f9e421-292d-4690-85e5-0ec46bcf8ba7 req-6765182d-86fc-449e-9150-06a477bf9bd0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034200 Aug 01 14:28:22.455697 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 422/827] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:23.206290 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3f5fc3c4-b3c0-4b4c-a62c-5dc14dd045b7 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:23.206907 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3f5fc3c4-b3c0-4b4c-a62c-5dc14dd045b7 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:23.208951 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=8 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:23.214661 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3f5fc3c4-b3c0-4b4c-a62c-5dc14dd045b7 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:23.215114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3f5fc3c4-b3c0-4b4c-a62c-5dc14dd045b7 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:23.215927 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3f5fc3c4-b3c0-4b4c-a62c-5dc14dd045b7 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:23.216365 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3f5fc3c4-b3c0-4b4c-a62c-5dc14dd045b7 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:23.353016 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3f5fc3c4-b3c0-4b4c-a62c-5dc14dd045b7 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:23.361514 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3f5fc3c4-b3c0-4b4c-a62c-5dc14dd045b7 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1266 microversion: 2.1 time: 0.159191 Aug 01 14:28:23.362137 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 406/828] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:23 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:24.383806 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b3790ebc-f4a8-40a7-b2f7-c32ba5cd5856 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:24.384511 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b3790ebc-f4a8-40a7-b2f7-c32ba5cd5856 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:24.391801 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b3790ebc-f4a8-40a7-b2f7-c32ba5cd5856 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:24.392191 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b3790ebc-f4a8-40a7-b2f7-c32ba5cd5856 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:24.392955 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b3790ebc-f4a8-40a7-b2f7-c32ba5cd5856 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:24.393396 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b3790ebc-f4a8-40a7-b2f7-c32ba5cd5856 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:24.527981 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b3790ebc-f4a8-40a7-b2f7-c32ba5cd5856 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:24.535628 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b3790ebc-f4a8-40a7-b2f7-c32ba5cd5856 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1266 microversion: 2.1 time: 0.156521 Aug 01 14:28:24.536243 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 423/829] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:24 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:25.556815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-2c66a360-f000-4a70-b7d0-1306bf99cf71 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:25.557431 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-2c66a360-f000-4a70-b7d0-1306bf99cf71 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:25.563991 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2c66a360-f000-4a70-b7d0-1306bf99cf71 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:25.564443 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2c66a360-f000-4a70-b7d0-1306bf99cf71 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:25.565211 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2c66a360-f000-4a70-b7d0-1306bf99cf71 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:25.565649 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2c66a360-f000-4a70-b7d0-1306bf99cf71 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:25.696414 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2c66a360-f000-4a70-b7d0-1306bf99cf71 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:25.704212 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-2c66a360-f000-4a70-b7d0-1306bf99cf71 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1266 microversion: 2.1 time: 0.151238 Aug 01 14:28:25.704790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 407/830] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:25 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:26.115675 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b27a7783-38f6-47d1-9211-25388c0385da tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:26.117887 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b27a7783-38f6-47d1-9211-25388c0385da tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:26.124331 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b27a7783-38f6-47d1-9211-25388c0385da tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:26.124789 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b27a7783-38f6-47d1-9211-25388c0385da tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:26.125591 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b27a7783-38f6-47d1-9211-25388c0385da tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:26.126063 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b27a7783-38f6-47d1-9211-25388c0385da tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:26.154304 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b27a7783-38f6-47d1-9211-25388c0385da tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042854 Aug 01 14:28:26.154850 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 424/831] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Aug 1 14:28:26 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:26.216171 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-2aa8c9bc-cf10-415b-a9d1-644cdb8b8c88 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:26.216602 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-2aa8c9bc-cf10-415b-a9d1-644cdb8b8c88 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:26.223083 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2aa8c9bc-cf10-415b-a9d1-644cdb8b8c88 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:26.223519 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2aa8c9bc-cf10-415b-a9d1-644cdb8b8c88 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:26.224264 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2aa8c9bc-cf10-415b-a9d1-644cdb8b8c88 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:26.224694 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2aa8c9bc-cf10-415b-a9d1-644cdb8b8c88 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:26.248768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-2aa8c9bc-cf10-415b-a9d1-644cdb8b8c88 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Going to try to terminate instance {{(pid=118246) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:28:26.601208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-2aa8c9bc-cf10-415b-a9d1-644cdb8b8c88 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "DELETE /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 204 len: 0 microversion: 2.20 time: 0.388690 Aug 01 14:28:26.601930 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 408/832] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Aug 1 14:28:26 2022] DELETE /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 14:28:26.610701 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-baf79219-c2df-4625-91d5-2066f0c2f4fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:26.611645 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-baf79219-c2df-4625-91d5-2066f0c2f4fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:26.617563 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-baf79219-c2df-4625-91d5-2066f0c2f4fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:26.618057 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-baf79219-c2df-4625-91d5-2066f0c2f4fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:26.618831 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-baf79219-c2df-4625-91d5-2066f0c2f4fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:26.619261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-baf79219-c2df-4625-91d5-2066f0c2f4fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:26.725739 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-9c8cbb5b-acc1-4dde-afb3-563446ffff0e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:26.726455 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-9c8cbb5b-acc1-4dde-afb3-563446ffff0e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:26.732600 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9c8cbb5b-acc1-4dde-afb3-563446ffff0e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:26.733507 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9c8cbb5b-acc1-4dde-afb3-563446ffff0e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:26.733988 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9c8cbb5b-acc1-4dde-afb3-563446ffff0e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:26.735015 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9c8cbb5b-acc1-4dde-afb3-563446ffff0e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:26.759060 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-baf79219-c2df-4625-91d5-2066f0c2f4fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:26.769148 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-baf79219-c2df-4625-91d5-2066f0c2f4fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:26.770688 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-baf79219-c2df-4625-91d5-2066f0c2f4fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:26.772456 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-baf79219-c2df-4625-91d5-2066f0c2f4fe tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.165553 Aug 01 14:28:26.773377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 425/833] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:28:26 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:28:26.900886 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-9c8cbb5b-acc1-4dde-afb3-563446ffff0e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:26.904478 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:26.908907 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-9c8cbb5b-acc1-4dde-afb3-563446ffff0e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1266 microversion: 2.1 time: 0.187455 Aug 01 14:28:26.909483 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 409/834] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:26 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:27.796435 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-5fa53092-d7b6-4b2f-9a3f-9bcd3d100a00 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:27.797080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-5fa53092-d7b6-4b2f-9a3f-9bcd3d100a00 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:27.803728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5fa53092-d7b6-4b2f-9a3f-9bcd3d100a00 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:27.804177 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5fa53092-d7b6-4b2f-9a3f-9bcd3d100a00 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:27.804945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5fa53092-d7b6-4b2f-9a3f-9bcd3d100a00 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:27.805387 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5fa53092-d7b6-4b2f-9a3f-9bcd3d100a00 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:27.930255 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-028b44dc-d84c-40dc-a22f-f1e9f738e274 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:27.932510 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-028b44dc-d84c-40dc-a22f-f1e9f738e274 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:27.941044 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-028b44dc-d84c-40dc-a22f-f1e9f738e274 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:27.941546 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-028b44dc-d84c-40dc-a22f-f1e9f738e274 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:27.942388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-028b44dc-d84c-40dc-a22f-f1e9f738e274 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:27.943526 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-028b44dc-d84c-40dc-a22f-f1e9f738e274 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:27.948579 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-5fa53092-d7b6-4b2f-9a3f-9bcd3d100a00 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:27.962746 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-5fa53092-d7b6-4b2f-9a3f-9bcd3d100a00 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:27.964467 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-5fa53092-d7b6-4b2f-9a3f-9bcd3d100a00 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:27.977995 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-5fa53092-d7b6-4b2f-9a3f-9bcd3d100a00 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.173186 Aug 01 14:28:27.977995 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 426/835] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:28:27 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:28:28.081264 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-028b44dc-d84c-40dc-a22f-f1e9f738e274 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:28.089248 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-028b44dc-d84c-40dc-a22f-f1e9f738e274 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1266 microversion: 2.1 time: 0.162869 Aug 01 14:28:28.089831 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 410/836] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:27 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:28:28.824670 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-554e297d-1a22-4dbc-b7a7-5e888f5371d8 req-4a0faec5-e312-4c89-8e20-48f04cd254dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a377af0-0542-410e-93c3-e8c076f16ce6", "name": "network-vif-plugged", "status": "completed", "tag": "416f1933-aa1d-4746-9f1f-44a8878036a3"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:28.835352 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-554e297d-1a22-4dbc-b7a7-5e888f5371d8 req-4a0faec5-e312-4c89-8e20-48f04cd254dc service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:28.835899 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-554e297d-1a22-4dbc-b7a7-5e888f5371d8 req-4a0faec5-e312-4c89-8e20-48f04cd254dc service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:28.848515 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-554e297d-1a22-4dbc-b7a7-5e888f5371d8 req-4a0faec5-e312-4c89-8e20-48f04cd254dc service nova] Creating event network-vif-plugged:416f1933-aa1d-4746-9f1f-44a8878036a3 for instance 6a377af0-0542-410e-93c3-e8c076f16ce6 on hv-cinder-78729 Aug 01 14:28:28.853118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-554e297d-1a22-4dbc-b7a7-5e888f5371d8 req-4a0faec5-e312-4c89-8e20-48f04cd254dc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032136 Aug 01 14:28:28.853708 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 427/837] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:28.991966 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-6c8f8208-8756-4a33-b20c-d52c38031f34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:28.993288 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-6c8f8208-8756-4a33-b20c-d52c38031f34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:28.999742 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6c8f8208-8756-4a33-b20c-d52c38031f34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:29.001054 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6c8f8208-8756-4a33-b20c-d52c38031f34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:29.002304 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6c8f8208-8756-4a33-b20c-d52c38031f34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:29.002754 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6c8f8208-8756-4a33-b20c-d52c38031f34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:29.110414 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d38e90db-9f18-4826-8fe6-fc86a0351e5f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:29.111249 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d38e90db-9f18-4826-8fe6-fc86a0351e5f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:29.118084 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d38e90db-9f18-4826-8fe6-fc86a0351e5f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:29.118786 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d38e90db-9f18-4826-8fe6-fc86a0351e5f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:29.119632 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d38e90db-9f18-4826-8fe6-fc86a0351e5f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:29.120174 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d38e90db-9f18-4826-8fe6-fc86a0351e5f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:29.141417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-6c8f8208-8756-4a33-b20c-d52c38031f34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:29.151383 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-6c8f8208-8756-4a33-b20c-d52c38031f34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:29.153034 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-6c8f8208-8756-4a33-b20c-d52c38031f34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:29.154095 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-6c8f8208-8756-4a33-b20c-d52c38031f34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1724 microversion: 2.20 time: 0.166653 Aug 01 14:28:29.154649 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 411/838] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:28:28 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:28:29.279498 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d38e90db-9f18-4826-8fe6-fc86a0351e5f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:29.288366 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d38e90db-9f18-4826-8fe6-fc86a0351e5f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1266 microversion: 2.1 time: 0.182603 Aug 01 14:28:29.289407 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 428/839] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:29 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:28:29.856720 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-4a5ab4d8-b39a-4d65-96d3-be246fb10772 req-b22eb5bb-6e2d-4cb5-9d2c-c141a40b5c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015b4877-f47b-4e45-a2b8-e36ba4bacf82", "name": "network-vif-deleted", "tag": "09014052-8b79-46d5-99ce-d8c6b6ccd445"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:29.867257 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-4a5ab4d8-b39a-4d65-96d3-be246fb10772 req-b22eb5bb-6e2d-4cb5-9d2c-c141a40b5c3c service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:29.867705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-4a5ab4d8-b39a-4d65-96d3-be246fb10772 req-b22eb5bb-6e2d-4cb5-9d2c-c141a40b5c3c service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:29.879686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-4a5ab4d8-b39a-4d65-96d3-be246fb10772 req-b22eb5bb-6e2d-4cb5-9d2c-c141a40b5c3c service nova] Creating event network-vif-deleted:09014052-8b79-46d5-99ce-d8c6b6ccd445 for instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 on hv-cinder-78729 Aug 01 14:28:29.884792 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-4a5ab4d8-b39a-4d65-96d3-be246fb10772 req-b22eb5bb-6e2d-4cb5-9d2c-c141a40b5c3c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031770 Aug 01 14:28:29.885557 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 412/840] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:30.178894 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1b222920-d7bb-42cc-8f8b-1fcade57f8a2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:30.179450 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1b222920-d7bb-42cc-8f8b-1fcade57f8a2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:30.186532 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1b222920-d7bb-42cc-8f8b-1fcade57f8a2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:30.186983 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1b222920-d7bb-42cc-8f8b-1fcade57f8a2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:30.187815 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1b222920-d7bb-42cc-8f8b-1fcade57f8a2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:30.188288 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1b222920-d7bb-42cc-8f8b-1fcade57f8a2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:30.207892 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=100 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:30.253965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1b222920-d7bb-42cc-8f8b-1fcade57f8a2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:30.261892 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1b222920-d7bb-42cc-8f8b-1fcade57f8a2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:30.263461 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1b222920-d7bb-42cc-8f8b-1fcade57f8a2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:30.264664 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1b222920-d7bb-42cc-8f8b-1fcade57f8a2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1366 microversion: 2.20 time: 0.089871 Aug 01 14:28:30.265310 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 429/841] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:28:30 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:28:30.311309 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-264c1225-2dd4-4a2a-abc1-de1c69602b2c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:30.312112 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-264c1225-2dd4-4a2a-abc1-de1c69602b2c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:30.318966 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-264c1225-2dd4-4a2a-abc1-de1c69602b2c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:30.319494 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-264c1225-2dd4-4a2a-abc1-de1c69602b2c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:30.320326 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-264c1225-2dd4-4a2a-abc1-de1c69602b2c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:30.320828 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-264c1225-2dd4-4a2a-abc1-de1c69602b2c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:30.465531 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-264c1225-2dd4-4a2a-abc1-de1c69602b2c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:30.471259 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-264c1225-2dd4-4a2a-abc1-de1c69602b2c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1266 microversion: 2.1 time: 0.164561 Aug 01 14:28:30.471886 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 413/842] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:30 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:31.287638 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-acd7e2cb-5a9c-47a9-a618-c0ab8d958987 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:31.288255 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-acd7e2cb-5a9c-47a9-a618-c0ab8d958987 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:31.294912 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-acd7e2cb-5a9c-47a9-a618-c0ab8d958987 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:31.295373 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-acd7e2cb-5a9c-47a9-a618-c0ab8d958987 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:31.296144 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-acd7e2cb-5a9c-47a9-a618-c0ab8d958987 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:31.296590 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-acd7e2cb-5a9c-47a9-a618-c0ab8d958987 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:31.326757 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-acd7e2cb-5a9c-47a9-a618-c0ab8d958987 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:31.327213 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-acd7e2cb-5a9c-47a9-a618-c0ab8d958987 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:31.327671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-acd7e2cb-5a9c-47a9-a618-c0ab8d958987 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lazy-loading 'fault' on Instance uuid 015b4877-f47b-4e45-a2b8-e36ba4bacf82 {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:28:31.372186 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-acd7e2cb-5a9c-47a9-a618-c0ab8d958987 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:31.380166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-acd7e2cb-5a9c-47a9-a618-c0ab8d958987 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:31.381678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-acd7e2cb-5a9c-47a9-a618-c0ab8d958987 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c4c1027d8a42c081d69fa821216675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bcd2b3241464b25a20c9d559ed9a049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:31.382871 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-acd7e2cb-5a9c-47a9-a618-c0ab8d958987 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 200 len: 1371 microversion: 2.20 time: 0.099715 Aug 01 14:28:31.383429 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 430/843] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:28:31 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:28:31.492514 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-dfdc440a-a104-4ac8-b3b1-196f1cf5e555 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:31.493127 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-dfdc440a-a104-4ac8-b3b1-196f1cf5e555 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:31.499761 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dfdc440a-a104-4ac8-b3b1-196f1cf5e555 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:31.500792 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dfdc440a-a104-4ac8-b3b1-196f1cf5e555 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:31.501635 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dfdc440a-a104-4ac8-b3b1-196f1cf5e555 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:31.502104 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-dfdc440a-a104-4ac8-b3b1-196f1cf5e555 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:31.795728 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-dfdc440a-a104-4ac8-b3b1-196f1cf5e555 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:31.804358 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-dfdc440a-a104-4ac8-b3b1-196f1cf5e555 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1454 microversion: 2.1 time: 0.316057 Aug 01 14:28:31.804939 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 414/844] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:31 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1454 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:31.825337 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ca9a632f-77b3-425b-84ab-43c6dd90ac0f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:31.825904 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ca9a632f-77b3-425b-84ab-43c6dd90ac0f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:31.832209 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ca9a632f-77b3-425b-84ab-43c6dd90ac0f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:31.832660 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ca9a632f-77b3-425b-84ab-43c6dd90ac0f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:31.836872 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ca9a632f-77b3-425b-84ab-43c6dd90ac0f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:31.836872 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ca9a632f-77b3-425b-84ab-43c6dd90ac0f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:31.973078 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ca9a632f-77b3-425b-84ab-43c6dd90ac0f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:31.980776 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ca9a632f-77b3-425b-84ab-43c6dd90ac0f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1454 microversion: 2.1 time: 0.159290 Aug 01 14:28:31.981976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 431/845] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:31 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:32.407757 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d208bbcb-eaec-4b29-8705-f308aaf8f5b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:32.408980 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d208bbcb-eaec-4b29-8705-f308aaf8f5b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:32.416115 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d208bbcb-eaec-4b29-8705-f308aaf8f5b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:32.416687 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d208bbcb-eaec-4b29-8705-f308aaf8f5b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:32.417536 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d208bbcb-eaec-4b29-8705-f308aaf8f5b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:32.418069 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d208bbcb-eaec-4b29-8705-f308aaf8f5b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:32.435003 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-d208bbcb-eaec-4b29-8705-f308aaf8f5b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] HTTP exception thrown: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d208bbcb-eaec-4b29-8705-f308aaf8f5b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Request method failure captured: Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 HTTP/1.1 Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-E4Kh_4Q5v4twlhojHMUYyrJe3rqBsyfE1im5S436Ixk8uQiMnLQ85UmraKwEIZ9zvhH0k5WtqYMmDVrU6__WpArXoYhaWHeSQ-xVJi-tyokMLo2sb-QZmjdT9iWAh7CqL7-RO-6_Vp9FlRWdUEosQOtmmho_h9Pw9pjgd8vXm4Xxo Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: 6bcd2b3241464b25a20c9d559ed9a049 Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:28:32.437501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:28:32.439275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:28:32.439275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:28:32.439275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: 6bcd2b3241464b25a20c9d559ed9a049 Aug 01 14:28:32.439275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:28:32.439275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-AttachVolumeShelveTestJSON-1335025751-project Aug 01 14:28:32.439275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:28:32.439275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:28:32.439275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: 14c4c1027d8a42c081d69fa821216675 Aug 01 14:28:32.439275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1335025751-project Aug 01 14:28:32.439275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:28:32.439275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. Aug 01 14:28:32.439275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': '015b4877-f47b-4e45-a2b8-e36ba4bacf82'} Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:28:32.440113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. Aug 01 14:28:32.441645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:28:32.444116 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d208bbcb-eaec-4b29-8705-f308aaf8f5b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Returning 404 to user: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:28:32.444116 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d208bbcb-eaec-4b29-8705-f308aaf8f5b2 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 404 len: 111 microversion: 2.20 time: 0.036339 Aug 01 14:28:32.444116 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 415/846] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:28:32 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:28:32.448973 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c3a8d123-2719-4c4d-a958-ebcd60b2c714 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '.version_select at 0x7fb254033ee0>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:32.544201 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c3a8d123-2719-4c4d-a958-ebcd60b2c714 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1743085022" status: 204 len: 0 microversion: 2.20 time: 0.098996 Aug 01 14:28:32.544793 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 432/847] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Aug 1 14:28:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1743085022 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 14:28:34.634345 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-4be60624-5960-40e7-87b1-7672158c6623 req-a07c3021-aab9-4c04-bc69-fd041ce2631c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a377af0-0542-410e-93c3-e8c076f16ce6", "tag": "416f1933-aa1d-4746-9f1f-44a8878036a3"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:34.643176 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-4be60624-5960-40e7-87b1-7672158c6623 req-a07c3021-aab9-4c04-bc69-fd041ce2631c service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:34.643679 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-4be60624-5960-40e7-87b1-7672158c6623 req-a07c3021-aab9-4c04-bc69-fd041ce2631c service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:34.655046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-4be60624-5960-40e7-87b1-7672158c6623 req-a07c3021-aab9-4c04-bc69-fd041ce2631c service nova] Creating event network-changed:416f1933-aa1d-4746-9f1f-44a8878036a3 for instance 6a377af0-0542-410e-93c3-e8c076f16ce6 on hv-cinder-78729 Aug 01 14:28:34.660827 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-4be60624-5960-40e7-87b1-7672158c6623 req-a07c3021-aab9-4c04-bc69-fd041ce2631c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032808 Aug 01 14:28:34.661545 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 416/848] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:35.154482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6b4ed338-47fb-4c7c-b244-dbb763b29784 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:35.155011 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-6b4ed338-47fb-4c7c-b244-dbb763b29784 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:35.158212 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:35.163322 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6b4ed338-47fb-4c7c-b244-dbb763b29784 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:35.163854 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6b4ed338-47fb-4c7c-b244-dbb763b29784 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:35.164857 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6b4ed338-47fb-4c7c-b244-dbb763b29784 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:35.165402 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6b4ed338-47fb-4c7c-b244-dbb763b29784 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:35.180962 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-6b4ed338-47fb-4c7c-b244-dbb763b29784 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] HTTP exception thrown: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6b4ed338-47fb-4c7c-b244-dbb763b29784 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Request method failure captured: Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: DELETE /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 HTTP/1.1 Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-E4Kh_4Q5v4twlhojHMUYyrJe3rqBsyfE1im5S436Ixk8uQiMnLQ85UmraKwEIZ9zvhH0k5WtqYMmDVrU6__WpArXoYhaWHeSQ-xVJi-tyokMLo2sb-QZmjdT9iWAh7CqL7-RO-6_Vp9FlRWdUEosQOtmmho_h9Pw9pjgd8vXm4Xxo Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: 6bcd2b3241464b25a20c9d559ed9a049 Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:28:35.183092 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:28:35.184460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:28:35.184460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:28:35.184460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: 6bcd2b3241464b25a20c9d559ed9a049 Aug 01 14:28:35.184460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:28:35.184460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-AttachVolumeShelveTestJSON-1335025751-project Aug 01 14:28:35.184460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:28:35.184460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:28:35.184460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: 14c4c1027d8a42c081d69fa821216675 Aug 01 14:28:35.184460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1335025751-project Aug 01 14:28:35.184460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:28:35.184460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. Aug 01 14:28:35.184460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '015b4877-f47b-4e45-a2b8-e36ba4bacf82'} Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:28:35.185194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. Aug 01 14:28:35.186437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:35.188412 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6b4ed338-47fb-4c7c-b244-dbb763b29784 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Returning 404 to user: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:28:35.188412 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-6b4ed338-47fb-4c7c-b244-dbb763b29784 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "DELETE /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 404 len: 111 microversion: 2.20 time: 0.036237 Aug 01 14:28:35.189914 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 433/849] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Aug 1 14:28:35 2022] DELETE /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:28:35.196254 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c3b1a241-367b-4b1b-8994-23369672dcb3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:35.196959 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c3b1a241-367b-4b1b-8994-23369672dcb3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 015b4877-f47b-4e45-a2b8-e36ba4bacf82] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:35.203147 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c3b1a241-367b-4b1b-8994-23369672dcb3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:35.203602 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c3b1a241-367b-4b1b-8994-23369672dcb3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:35.204570 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c3b1a241-367b-4b1b-8994-23369672dcb3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:35.205005 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c3b1a241-367b-4b1b-8994-23369672dcb3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:35.220175 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-c3b1a241-367b-4b1b-8994-23369672dcb3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] HTTP exception thrown: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c3b1a241-367b-4b1b-8994-23369672dcb3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Request method failure captured: Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 HTTP/1.1 Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-E4Kh_4Q5v4twlhojHMUYyrJe3rqBsyfE1im5S436Ixk8uQiMnLQ85UmraKwEIZ9zvhH0k5WtqYMmDVrU6__WpArXoYhaWHeSQ-xVJi-tyokMLo2sb-QZmjdT9iWAh7CqL7-RO-6_Vp9FlRWdUEosQOtmmho_h9Pw9pjgd8vXm4Xxo Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: 6bcd2b3241464b25a20c9d559ed9a049 Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:28:35.222456 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:28:35.224140 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:28:35.224140 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:28:35.224140 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: 6bcd2b3241464b25a20c9d559ed9a049 Aug 01 14:28:35.224140 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:28:35.224140 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-AttachVolumeShelveTestJSON-1335025751-project Aug 01 14:28:35.224140 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:28:35.224140 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:28:35.224140 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: 14c4c1027d8a42c081d69fa821216675 Aug 01 14:28:35.224140 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1335025751-project Aug 01 14:28:35.224140 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:28:35.224140 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. Aug 01 14:28:35.224140 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': '015b4877-f47b-4e45-a2b8-e36ba4bacf82'} Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:28:35.225144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. Aug 01 14:28:35.226585 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:28:35.227896 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c3b1a241-367b-4b1b-8994-23369672dcb3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Returning 404 to user: Instance 015b4877-f47b-4e45-a2b8-e36ba4bacf82 could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:28:35.227896 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c3b1a241-367b-4b1b-8994-23369672dcb3 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82" status: 404 len: 111 microversion: 2.20 time: 0.033362 Aug 01 14:28:35.229331 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 417/850] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:28:35 2022] GET /compute/v2.1/servers/015b4877-f47b-4e45-a2b8-e36ba4bacf82 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:28:36.573990 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-fe1a4562-c40a-44aa-ac76-8c0507429b34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:36.574474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-fe1a4562-c40a-44aa-ac76-8c0507429b34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:36.582021 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fe1a4562-c40a-44aa-ac76-8c0507429b34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:36.582477 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fe1a4562-c40a-44aa-ac76-8c0507429b34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:36.583250 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fe1a4562-c40a-44aa-ac76-8c0507429b34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:36.583697 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fe1a4562-c40a-44aa-ac76-8c0507429b34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:36.600484 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-fe1a4562-c40a-44aa-ac76-8c0507429b34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] HTTP exception thrown: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-fe1a4562-c40a-44aa-ac76-8c0507429b34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Request method failure captured: Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: DELETE /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 HTTP/1.1 Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-E4Kh_4Q5v4twlhojHMUYyrJe3rqBsyfE1im5S436Ixk8uQiMnLQ85UmraKwEIZ9zvhH0k5WtqYMmDVrU6__WpArXoYhaWHeSQ-xVJi-tyokMLo2sb-QZmjdT9iWAh7CqL7-RO-6_Vp9FlRWdUEosQOtmmho_h9Pw9pjgd8vXm4Xxo Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: 6bcd2b3241464b25a20c9d559ed9a049 Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:28:36.603180 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:28:36.604805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:28:36.604805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:28:36.604805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: 6bcd2b3241464b25a20c9d559ed9a049 Aug 01 14:28:36.604805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:28:36.604805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-AttachVolumeShelveTestJSON-1335025751-project Aug 01 14:28:36.604805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:28:36.604805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:28:36.604805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: 14c4c1027d8a42c081d69fa821216675 Aug 01 14:28:36.604805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1335025751-project Aug 01 14:28:36.604805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:28:36.604805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. Aug 01 14:28:36.604805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '9c41c564-40f2-47cf-820b-915c3d43ccb3'} Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:28:36.605623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. Aug 01 14:28:36.606869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:36.608032 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-fe1a4562-c40a-44aa-ac76-8c0507429b34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Returning 404 to user: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:28:36.608032 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-fe1a4562-c40a-44aa-ac76-8c0507429b34 tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 404 len: 111 microversion: 2.20 time: 0.034732 Aug 01 14:28:36.608032 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 434/851] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Aug 1 14:28:36 2022] DELETE /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:28:36.613290 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c0520d0a-7fa8-4825-849f-529d8c429b0f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:36.615107 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c0520d0a-7fa8-4825-849f-529d8c429b0f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] [instance: 9c41c564-40f2-47cf-820b-915c3d43ccb3] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:36.620639 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c0520d0a-7fa8-4825-849f-529d8c429b0f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:36.621088 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c0520d0a-7fa8-4825-849f-529d8c429b0f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:36.621865 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c0520d0a-7fa8-4825-849f-529d8c429b0f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:36.622295 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c0520d0a-7fa8-4825-849f-529d8c429b0f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:36.635516 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-c0520d0a-7fa8-4825-849f-529d8c429b0f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] HTTP exception thrown: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c0520d0a-7fa8-4825-849f-529d8c429b0f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Request method failure captured: Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 HTTP/1.1 Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-E4Kh_4Q5v4twlhojHMUYyrJe3rqBsyfE1im5S436Ixk8uQiMnLQ85UmraKwEIZ9zvhH0k5WtqYMmDVrU6__WpArXoYhaWHeSQ-xVJi-tyokMLo2sb-QZmjdT9iWAh7CqL7-RO-6_Vp9FlRWdUEosQOtmmho_h9Pw9pjgd8vXm4Xxo Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: 6bcd2b3241464b25a20c9d559ed9a049 Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:28:36.637037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:28:36.639648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6bcd2b3241464b25a20c9d559ed9a049"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:28:36.639648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:28:36.639648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: 6bcd2b3241464b25a20c9d559ed9a049 Aug 01 14:28:36.639648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1335025751 Aug 01 14:28:36.639648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-AttachVolumeShelveTestJSON-1335025751-project Aug 01 14:28:36.639648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:28:36.639648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:28:36.639648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: 14c4c1027d8a42c081d69fa821216675 Aug 01 14:28:36.639648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1335025751-project Aug 01 14:28:36.639648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:28:36.639648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. Aug 01 14:28:36.639648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': '9c41c564-40f2-47cf-820b-915c3d43ccb3'} Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:28:36.641068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. Aug 01 14:28:36.642645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:28:36.643998 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c0520d0a-7fa8-4825-849f-529d8c429b0f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] Returning 404 to user: Instance 9c41c564-40f2-47cf-820b-915c3d43ccb3 could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:28:36.643998 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c0520d0a-7fa8-4825-849f-529d8c429b0f tempest-AttachVolumeShelveTestJSON-1335025751 tempest-AttachVolumeShelveTestJSON-1335025751-project] 10.222.0.49 "GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3" status: 404 len: 111 microversion: 2.20 time: 0.029011 Aug 01 14:28:36.643998 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 418/852] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Aug 1 14:28:36 2022] GET /compute/v2.1/servers/9c41c564-40f2-47cf-820b-915c3d43ccb3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:28:42.267924 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3caf9623-9916-49a1-b604-7606d3dabb18 tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] Action: 'create', calling method: .version_select at 0x7fb24f727dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1477706356", "metadata": {"Type": "work"}}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:42.905326 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3caf9623-9916-49a1-b604-7606d3dabb18 tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.778167 Aug 01 14:28:42.905326 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 435/853] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Aug 1 14:28:42 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 780 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 14:28:42.917344 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-909d619c-1be9-4649-ad96-f697cd847500 tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] Calling method '.version_select at 0x7fb24eea30d0>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:42.974251 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-909d619c-1be9-4649-ad96-f697cd847500 tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4a946791-0651-4be8-be7e-03509fd49414" status: 200 len: 353 microversion: 2.1 time: 0.054615 Aug 01 14:28:42.974251 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 419/854] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Aug 1 14:28:42 2022] GET /compute/v2.1/os-volumes/4a946791-0651-4be8-be7e-03509fd49414 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:43.982448 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ee843025-22a9-4252-9a05-26afbb33ab26 tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] Calling method '.version_select at 0x7fb258164550>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:44.033388 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ee843025-22a9-4252-9a05-26afbb33ab26 tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4a946791-0651-4be8-be7e-03509fd49414" status: 200 len: 354 microversion: 2.1 time: 0.055205 Aug 01 14:28:44.034058 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 436/855] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Aug 1 14:28:43 2022] GET /compute/v2.1/os-volumes/4a946791-0651-4be8-be7e-03509fd49414 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:44.050790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5a206106-287b-4b30-9698-8097e1689e31 tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] Calling method '.version_select at 0x7fb24ef05c10>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:44.097647 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5a206106-287b-4b30-9698-8097e1689e31 tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4a946791-0651-4be8-be7e-03509fd49414" status: 200 len: 354 microversion: 2.1 time: 0.051053 Aug 01 14:28:44.098232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 420/856] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Aug 1 14:28:44 2022] GET /compute/v2.1/os-volumes/4a946791-0651-4be8-be7e-03509fd49414 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:44.115654 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4dba8f99-d492-4ae4-8d9b-539e9f23b342 tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] Calling method '.version_select at 0x7fb24f7803a0>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:44.321160 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4dba8f99-d492-4ae4-8d9b-539e9f23b342 tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/4a946791-0651-4be8-be7e-03509fd49414" status: 202 len: 0 microversion: 2.1 time: 0.209491 Aug 01 14:28:44.321720 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 437/857] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Aug 1 14:28:44 2022] DELETE /compute/v2.1/os-volumes/4a946791-0651-4be8-be7e-03509fd49414 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:28:44.330474 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-624eae7a-a2b2-49c0-917a-37f5bb391237 tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] Calling method '.version_select at 0x7fb24ef05ee0>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:44.379096 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-624eae7a-a2b2-49c0-917a-37f5bb391237 tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4a946791-0651-4be8-be7e-03509fd49414" status: 200 len: 353 microversion: 2.1 time: 0.052955 Aug 01 14:28:44.379467 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 421/858] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Aug 1 14:28:44 2022] GET /compute/v2.1/os-volumes/4a946791-0651-4be8-be7e-03509fd49414 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:45.393626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-74b01e9d-16cc-4abd-9c3c-fff241eabceb tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] Calling method '.version_select at 0x7fb24f734a60>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-74b01e9d-16cc-4abd-9c3c-fff241eabceb tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] HTTP exception thrown: Volume 4a946791-0651-4be8-be7e-03509fd49414 could not be found. Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-74b01e9d-16cc-4abd-9c3c-fff241eabceb tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] Request method failure captured: Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/os-volumes/4a946791-0651-4be8-be7e-03509fd49414 HTTP/1.1 Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-Malj-YO9MTjEqVpdvWA3sP7KPSbJG0v_Lr_3aoZaeU0K3ATndNWHSyc86_qHfxCNJkEdj6Nbqubzwaez0y01laBgDN3cIzFtOnKvtHPVFcnbAVHkgQZE-Yk2rkDwyusYznwDPT9AUV73117gUIxXDk-zeueaYdqiRcri1Dyybr4lE Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: f504050fe9394c6da08c8916ea56e016 Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-VolumesGetTestJSON-1421528171 Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:28:45.428341 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:28:45.430090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f504050fe9394c6da08c8916ea56e016"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f504050fe9394c6da08c8916ea56e016"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f504050fe9394c6da08c8916ea56e016"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f504050fe9394c6da08c8916ea56e016"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:28:45.430090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-VolumesGetTestJSON-1421528171 Aug 01 14:28:45.430090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: f504050fe9394c6da08c8916ea56e016 Aug 01 14:28:45.430090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-VolumesGetTestJSON-1421528171 Aug 01 14:28:45.430090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-VolumesGetTestJSON-1421528171-project Aug 01 14:28:45.430090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:28:45.430090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:28:45.430090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: fe5405ddce61451e9f3d0b61d222db44 Aug 01 14:28:45.430090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-VolumesGetTestJSON-1421528171-project Aug 01 14:28:45.430090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: Aug 01 14:28:45.430090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Volume 4a946791-0651-4be8-be7e-03509fd49414 could not be found. Aug 01 14:28:45.430090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '4a946791-0651-4be8-be7e-03509fd49414'} Aug 01 14:28:45.430090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4a946791-0651-4be8-be7e-03509fd49414 could not be found. (HTTP 404) (Request-ID: req-209cf25b-9bb1-4692-9c53-5ca3e3a2c62c) Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:28:45.431129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:28:45.433137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4a946791-0651-4be8-be7e-03509fd49414 could not be found. Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 14:28:45.434569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:28:45.435965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4a946791-0651-4be8-be7e-03509fd49414 could not be found. Aug 01 14:28:45.435965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:45.435965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:28:45.435965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:45.435965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:28:45.435965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:28:45.435965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:28:45.435965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:28:45.435965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:28:45.435965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4a946791-0651-4be8-be7e-03509fd49414 could not be found. Aug 01 14:28:45.435965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:28:45.435965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-74b01e9d-16cc-4abd-9c3c-fff241eabceb tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] Returning 404 to user: Volume 4a946791-0651-4be8-be7e-03509fd49414 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:28:45.435965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-74b01e9d-16cc-4abd-9c3c-fff241eabceb tempest-VolumesGetTestJSON-1421528171 tempest-VolumesGetTestJSON-1421528171-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4a946791-0651-4be8-be7e-03509fd49414" status: 404 len: 109 microversion: 2.1 time: 0.036609 Aug 01 14:28:45.435965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 438/859] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Aug 1 14:28:45 2022] GET /compute/v2.1/os-volumes/4a946791-0651-4be8-be7e-03509fd49414 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:28:52.841692 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:52.842468 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=34 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:52.846472 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8716c495-7f6b-4194-b7be-a87f918b41a3 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1045158972", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452", "networks": [{"uuid": "9dbe0bb1-fc8d-48d5-83fe-cb294b52d367"}]}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:52.898951 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.network.neutron [None req-8716c495-7f6b-4194-b7be-a87f918b41a3 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] validate_networks() for [('9dbe0bb1-fc8d-48d5-83fe-cb294b52d367', None, None, None, None, None)] {{(pid=118246) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:28:53.245532 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-8716c495-7f6b-4194-b7be-a87f918b41a3 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Flavor limits 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:28:53.246014 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-8716c495-7f6b-4194-b7be-a87f918b41a3 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Image limits 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:28:53.246497 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-8716c495-7f6b-4194-b7be-a87f918b41a3 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Flavor pref 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:28:53.246907 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-8716c495-7f6b-4194-b7be-a87f918b41a3 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Image pref 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:28:53.247316 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-8716c495-7f6b-4194-b7be-a87f918b41a3 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:28:53.256609 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8716c495-7f6b-4194-b7be-a87f918b41a3 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:53.257056 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8716c495-7f6b-4194-b7be-a87f918b41a3 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:53.257894 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8716c495-7f6b-4194-b7be-a87f918b41a3 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:53.258332 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8716c495-7f6b-4194-b7be-a87f918b41a3 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:53.274666 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-8716c495-7f6b-4194-b7be-a87f918b41a3 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Getting quotas for project 1d3ebdfb4edd4ba1ad6438a68e325219. Resources: {'ram', 'cores', 'instances'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:28:53.278567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-8716c495-7f6b-4194-b7be-a87f918b41a3 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Getting quotas for user 3c12318332b64ca1b1b9937852215eaa and project 1d3ebdfb4edd4ba1ad6438a68e325219. Resources: {'ram', 'cores', 'instances'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:28:53.289789 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8716c495-7f6b-4194-b7be-a87f918b41a3 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Going to run 1 instances... {{(pid=118246) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:28:53.292069 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8716c495-7f6b-4194-b7be-a87f918b41a3 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118246) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:28:53.458079 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8716c495-7f6b-4194-b7be-a87f918b41a3 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617452 Aug 01 14:28:53.458629 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 422/860] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:28:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:28:53.466551 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=20 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:53.468030 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=3 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:53.472482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c9fc960a-1c09-4122-b491-9ff0d8a6818a tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:53.473095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c9fc960a-1c09-4122-b491-9ff0d8a6818a tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:53.530216 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c9fc960a-1c09-4122-b491-9ff0d8a6818a tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:53.539357 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c9fc960a-1c09-4122-b491-9ff0d8a6818a tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1214 microversion: 2.1 time: 0.073321 Aug 01 14:28:53.539357 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 439/861] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:53 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:54.559800 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4a2f7755-f278-469d-ac6d-b35188e96dfb tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:54.560415 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4a2f7755-f278-469d-ac6d-b35188e96dfb tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:54.567196 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4a2f7755-f278-469d-ac6d-b35188e96dfb tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:54.567651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4a2f7755-f278-469d-ac6d-b35188e96dfb tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:54.568405 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4a2f7755-f278-469d-ac6d-b35188e96dfb tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:54.568840 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4a2f7755-f278-469d-ac6d-b35188e96dfb tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:54.629699 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4a2f7755-f278-469d-ac6d-b35188e96dfb tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:54.637019 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4a2f7755-f278-469d-ac6d-b35188e96dfb tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1218 microversion: 2.1 time: 0.081696 Aug 01 14:28:54.637572 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 423/862] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:54 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:55.657783 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3311a6c2-5bf7-4af4-8c11-a898e889f60d tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:55.659118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3311a6c2-5bf7-4af4-8c11-a898e889f60d tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:55.665741 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3311a6c2-5bf7-4af4-8c11-a898e889f60d tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:55.666223 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3311a6c2-5bf7-4af4-8c11-a898e889f60d tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:55.666996 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3311a6c2-5bf7-4af4-8c11-a898e889f60d tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:55.667436 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3311a6c2-5bf7-4af4-8c11-a898e889f60d tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:55.732252 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3311a6c2-5bf7-4af4-8c11-a898e889f60d tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:55.740945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3311a6c2-5bf7-4af4-8c11-a898e889f60d tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1266 microversion: 2.1 time: 0.087190 Aug 01 14:28:55.741493 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 440/863] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:55 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:56.128824 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e9a5a891-0463-405d-a1d8-5825aa9d956c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:56.129457 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e9a5a891-0463-405d-a1d8-5825aa9d956c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:56.136311 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e9a5a891-0463-405d-a1d8-5825aa9d956c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:56.136767 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e9a5a891-0463-405d-a1d8-5825aa9d956c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:56.137542 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e9a5a891-0463-405d-a1d8-5825aa9d956c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:56.138014 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e9a5a891-0463-405d-a1d8-5825aa9d956c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:56.161547 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-e9a5a891-0463-405d-a1d8-5825aa9d956c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lazy-loading 'flavor' on Instance uuid 4551bd54-cfbb-4d79-913e-6380a1e0f5f1 {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:28:56.439357 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e9a5a891-0463-405d-a1d8-5825aa9d956c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "POST /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1/action" status: 202 len: 0 microversion: 2.1 time: 0.315081 Aug 01 14:28:56.440003 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 424/864] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Aug 1 14:28:56 2022] POST /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:28:56.450411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3fd76084-5d2a-424e-bb42-0ddfcf0a7bd8 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:56.451029 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3fd76084-5d2a-424e-bb42-0ddfcf0a7bd8 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:56.458432 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3fd76084-5d2a-424e-bb42-0ddfcf0a7bd8 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:56.458882 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3fd76084-5d2a-424e-bb42-0ddfcf0a7bd8 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:56.459690 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3fd76084-5d2a-424e-bb42-0ddfcf0a7bd8 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:56.460125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3fd76084-5d2a-424e-bb42-0ddfcf0a7bd8 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:56.597490 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-3fd76084-5d2a-424e-bb42-0ddfcf0a7bd8 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:56.605013 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3fd76084-5d2a-424e-bb42-0ddfcf0a7bd8 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1567 microversion: 2.1 time: 0.160234 Aug 01 14:28:56.605569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 441/865] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:56 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:28:56.762205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-19bf0cee-001f-4e21-9c53-0c8db0e36ade tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:56.762907 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-19bf0cee-001f-4e21-9c53-0c8db0e36ade tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:56.769764 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-19bf0cee-001f-4e21-9c53-0c8db0e36ade tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:56.770220 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-19bf0cee-001f-4e21-9c53-0c8db0e36ade tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:56.770989 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-19bf0cee-001f-4e21-9c53-0c8db0e36ade tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:56.771429 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-19bf0cee-001f-4e21-9c53-0c8db0e36ade tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:56.907888 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-19bf0cee-001f-4e21-9c53-0c8db0e36ade tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:56.915938 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-19bf0cee-001f-4e21-9c53-0c8db0e36ade tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1314 microversion: 2.1 time: 0.157951 Aug 01 14:28:56.916509 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 425/866] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:56 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:57.547080 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-acca9066-5094-45bf-9fc9-e495ec6842ea req-33d5a7a5-7de6-4292-bc99-05634ae5fc3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527ad0e8-34b3-462c-b5c2-c8b759bf4dd8", "tag": "42ece8b2-e2b3-4dff-8b12-50aa1fa64914"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:28:57.557483 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-acca9066-5094-45bf-9fc9-e495ec6842ea req-33d5a7a5-7de6-4292-bc99-05634ae5fc3a service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:57.557966 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-acca9066-5094-45bf-9fc9-e495ec6842ea req-33d5a7a5-7de6-4292-bc99-05634ae5fc3a service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:57.569471 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-acca9066-5094-45bf-9fc9-e495ec6842ea req-33d5a7a5-7de6-4292-bc99-05634ae5fc3a service nova] Creating event network-changed:42ece8b2-e2b3-4dff-8b12-50aa1fa64914 for instance 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 on hv-cinder-78729 Aug 01 14:28:57.574473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-acca9066-5094-45bf-9fc9-e495ec6842ea req-33d5a7a5-7de6-4292-bc99-05634ae5fc3a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031133 Aug 01 14:28:57.575246 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 442/867] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:57.628165 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-47ca7e83-0040-48fa-9eee-7a3b224d8422 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:57.629187 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-47ca7e83-0040-48fa-9eee-7a3b224d8422 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:57.637222 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-47ca7e83-0040-48fa-9eee-7a3b224d8422 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:57.637770 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-47ca7e83-0040-48fa-9eee-7a3b224d8422 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:57.638817 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-47ca7e83-0040-48fa-9eee-7a3b224d8422 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:57.639315 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-47ca7e83-0040-48fa-9eee-7a3b224d8422 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:57.773886 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-47ca7e83-0040-48fa-9eee-7a3b224d8422 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:57.781956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-47ca7e83-0040-48fa-9eee-7a3b224d8422 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1567 microversion: 2.1 time: 0.158838 Aug 01 14:28:57.782702 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 426/868] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:57 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:57.938796 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7fd883c5-fed6-404a-95cd-563cdf3ed49c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:57.939634 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7fd883c5-fed6-404a-95cd-563cdf3ed49c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:57.946206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7fd883c5-fed6-404a-95cd-563cdf3ed49c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:57.946660 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7fd883c5-fed6-404a-95cd-563cdf3ed49c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:57.947455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7fd883c5-fed6-404a-95cd-563cdf3ed49c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:57.947898 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7fd883c5-fed6-404a-95cd-563cdf3ed49c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:58.084973 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7fd883c5-fed6-404a-95cd-563cdf3ed49c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:58.092424 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7fd883c5-fed6-404a-95cd-563cdf3ed49c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1314 microversion: 2.1 time: 0.157759 Aug 01 14:28:58.092989 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 443/869] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:57 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:58.563841 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-6c4607d0-102f-4db4-82d3-8f3e39396d7c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:58.564264 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-6c4607d0-102f-4db4-82d3-8f3e39396d7c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:58.571095 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6c4607d0-102f-4db4-82d3-8f3e39396d7c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:58.571547 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6c4607d0-102f-4db4-82d3-8f3e39396d7c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:58.572306 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6c4607d0-102f-4db4-82d3-8f3e39396d7c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:58.572743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6c4607d0-102f-4db4-82d3-8f3e39396d7c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:58.595716 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-6c4607d0-102f-4db4-82d3-8f3e39396d7c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df/ips" status: 200 len: 149 microversion: 2.1 time: 0.035811 Aug 01 14:28:58.596278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 427/870] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Aug 1 14:28:58 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:28:58.804728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-2f1f7c9a-b244-4f10-acb7-79299dadd9a7 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:58.805371 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-2f1f7c9a-b244-4f10-acb7-79299dadd9a7 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:58.811825 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2f1f7c9a-b244-4f10-acb7-79299dadd9a7 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:58.812283 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2f1f7c9a-b244-4f10-acb7-79299dadd9a7 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:58.813052 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2f1f7c9a-b244-4f10-acb7-79299dadd9a7 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:58.813491 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2f1f7c9a-b244-4f10-acb7-79299dadd9a7 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:58.947953 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2f1f7c9a-b244-4f10-acb7-79299dadd9a7 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:58.955460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-2f1f7c9a-b244-4f10-acb7-79299dadd9a7 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1567 microversion: 2.1 time: 0.154517 Aug 01 14:28:58.956078 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 444/871] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:58 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:59.114080 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-6033554e-e8ec-4bdb-b6c3-aa183e7c0c55 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:59.114951 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-6033554e-e8ec-4bdb-b6c3-aa183e7c0c55 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:59.120874 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6033554e-e8ec-4bdb-b6c3-aa183e7c0c55 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:59.121322 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6033554e-e8ec-4bdb-b6c3-aa183e7c0c55 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:59.122107 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6033554e-e8ec-4bdb-b6c3-aa183e7c0c55 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:59.122541 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6033554e-e8ec-4bdb-b6c3-aa183e7c0c55 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:59.258079 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-6033554e-e8ec-4bdb-b6c3-aa183e7c0c55 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:28:59.265671 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-6033554e-e8ec-4bdb-b6c3-aa183e7c0c55 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1314 microversion: 2.1 time: 0.155884 Aug 01 14:28:59.266277 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 428/872] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:59 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:28:59.976663 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-fd41dd0a-c4c5-4be3-9984-c9a731a84ab6 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:28:59.977277 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-fd41dd0a-c4c5-4be3-9984-c9a731a84ab6 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:28:59.983876 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fd41dd0a-c4c5-4be3-9984-c9a731a84ab6 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:59.984333 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fd41dd0a-c4c5-4be3-9984-c9a731a84ab6 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:28:59.985105 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fd41dd0a-c4c5-4be3-9984-c9a731a84ab6 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:28:59.985549 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fd41dd0a-c4c5-4be3-9984-c9a731a84ab6 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:00.119415 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-fd41dd0a-c4c5-4be3-9984-c9a731a84ab6 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:00.126985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-fd41dd0a-c4c5-4be3-9984-c9a731a84ab6 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1567 microversion: 2.1 time: 0.154147 Aug 01 14:29:00.127949 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 445/873] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:28:59 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:00.284471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1836a5c1-bf43-4e26-b6e5-b199b19d65f6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7b472e2-73ca-4170-a4c4-9aa3d66ddf96"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:29:00.287052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-1836a5c1-bf43-4e26-b6e5-b199b19d65f6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:00.287453 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b491ef13-90d5-4d07-9506-947752d11fe7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:00.288064 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b491ef13-90d5-4d07-9506-947752d11fe7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:00.293473 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1836a5c1-bf43-4e26-b6e5-b199b19d65f6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:00.293965 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1836a5c1-bf43-4e26-b6e5-b199b19d65f6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:00.294083 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b491ef13-90d5-4d07-9506-947752d11fe7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:00.294519 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b491ef13-90d5-4d07-9506-947752d11fe7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:00.294738 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1836a5c1-bf43-4e26-b6e5-b199b19d65f6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:00.295176 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1836a5c1-bf43-4e26-b6e5-b199b19d65f6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:00.295289 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b491ef13-90d5-4d07-9506-947752d11fe7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:00.295724 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b491ef13-90d5-4d07-9506-947752d11fe7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:00.429808 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b491ef13-90d5-4d07-9506-947752d11fe7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:00.437167 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b491ef13-90d5-4d07-9506-947752d11fe7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1314 microversion: 2.1 time: 0.154294 Aug 01 14:29:00.443246 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 446/874] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:00 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:29:01.022595 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-1836a5c1-bf43-4e26-b6e5-b199b19d65f6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "POST /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.742817 Aug 01 14:29:01.023277 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 429/875] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Aug 1 14:29:00 2022] POST /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df/os-volume_attachments => generated 194 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:29:01.148959 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6f0c770c-a70e-4656-b074-6421749c90f5 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:01.149603 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-6f0c770c-a70e-4656-b074-6421749c90f5 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:01.156125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6f0c770c-a70e-4656-b074-6421749c90f5 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:01.156578 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6f0c770c-a70e-4656-b074-6421749c90f5 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:01.157345 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6f0c770c-a70e-4656-b074-6421749c90f5 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:01.157881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6f0c770c-a70e-4656-b074-6421749c90f5 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:01.292436 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6f0c770c-a70e-4656-b074-6421749c90f5 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:01.300053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-6f0c770c-a70e-4656-b074-6421749c90f5 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1567 microversion: 2.1 time: 0.155028 Aug 01 14:29:01.300614 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 447/876] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:01 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:01.463562 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-ca95faf4-7435-4cf8-9810-cf5fc6159e6b tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:01.464255 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-ca95faf4-7435-4cf8-9810-cf5fc6159e6b tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:01.471002 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ca95faf4-7435-4cf8-9810-cf5fc6159e6b tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:01.471514 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ca95faf4-7435-4cf8-9810-cf5fc6159e6b tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:01.472377 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ca95faf4-7435-4cf8-9810-cf5fc6159e6b tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:01.473102 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-ca95faf4-7435-4cf8-9810-cf5fc6159e6b tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:01.605910 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-ca95faf4-7435-4cf8-9810-cf5fc6159e6b tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:01.613467 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-ca95faf4-7435-4cf8-9810-cf5fc6159e6b tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1314 microversion: 2.1 time: 0.154555 Aug 01 14:29:01.614093 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 430/877] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:01 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:02.322171 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-626c2829-6a00-4181-9ba7-ecb93cfcf7db tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:02.322781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-626c2829-6a00-4181-9ba7-ecb93cfcf7db tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:02.328933 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-626c2829-6a00-4181-9ba7-ecb93cfcf7db tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:02.329385 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-626c2829-6a00-4181-9ba7-ecb93cfcf7db tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:02.330194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-626c2829-6a00-4181-9ba7-ecb93cfcf7db tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:02.330636 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-626c2829-6a00-4181-9ba7-ecb93cfcf7db tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:02.464907 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-626c2829-6a00-4181-9ba7-ecb93cfcf7db tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:02.472477 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-626c2829-6a00-4181-9ba7-ecb93cfcf7db tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1567 microversion: 2.1 time: 0.154928 Aug 01 14:29:02.473061 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 448/878] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:02 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:02.636069 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8eafb0c3-3bae-41a3-a2fe-565071ecd246 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:02.636680 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8eafb0c3-3bae-41a3-a2fe-565071ecd246 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:02.643177 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8eafb0c3-3bae-41a3-a2fe-565071ecd246 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:02.643704 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8eafb0c3-3bae-41a3-a2fe-565071ecd246 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:02.644417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8eafb0c3-3bae-41a3-a2fe-565071ecd246 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:02.644856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8eafb0c3-3bae-41a3-a2fe-565071ecd246 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:02.774245 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8eafb0c3-3bae-41a3-a2fe-565071ecd246 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:02.781531 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8eafb0c3-3bae-41a3-a2fe-565071ecd246 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1314 microversion: 2.1 time: 0.149283 Aug 01 14:29:02.782126 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 431/879] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:02 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:03.024412 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-cd7b6490-5ddf-49a8-88c0-cfcd390dcc26 req-b266c75c-4eb9-4074-934f-8b109797f192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527ad0e8-34b3-462c-b5c2-c8b759bf4dd8", "name": "network-vif-plugged", "status": "completed", "tag": "42ece8b2-e2b3-4dff-8b12-50aa1fa64914"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:29:03.034700 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-cd7b6490-5ddf-49a8-88c0-cfcd390dcc26 req-b266c75c-4eb9-4074-934f-8b109797f192 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:03.035276 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-cd7b6490-5ddf-49a8-88c0-cfcd390dcc26 req-b266c75c-4eb9-4074-934f-8b109797f192 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:03.045959 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-cd7b6490-5ddf-49a8-88c0-cfcd390dcc26 req-b266c75c-4eb9-4074-934f-8b109797f192 service nova] Creating event network-vif-plugged:42ece8b2-e2b3-4dff-8b12-50aa1fa64914 for instance 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 on hv-cinder-78729 Aug 01 14:29:03.052895 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-cd7b6490-5ddf-49a8-88c0-cfcd390dcc26 req-b266c75c-4eb9-4074-934f-8b109797f192 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030735 Aug 01 14:29:03.052895 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 449/880] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:29:03.494756 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-baef11af-e660-41a2-9f89-7eb9202e55a3 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:03.503362 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-baef11af-e660-41a2-9f89-7eb9202e55a3 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:03.503362 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=2 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:03.503362 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=6 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:03.503748 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-baef11af-e660-41a2-9f89-7eb9202e55a3 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:03.504294 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-baef11af-e660-41a2-9f89-7eb9202e55a3 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:03.505060 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-baef11af-e660-41a2-9f89-7eb9202e55a3 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:03.505495 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-baef11af-e660-41a2-9f89-7eb9202e55a3 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:03.635879 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-baef11af-e660-41a2-9f89-7eb9202e55a3 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:03.643634 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-baef11af-e660-41a2-9f89-7eb9202e55a3 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1567 microversion: 2.1 time: 0.152614 Aug 01 14:29:03.644316 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 432/881] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:03 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:03.803841 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e7a21efb-029e-4fa3-b506-5e3805bc678c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:03.804544 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e7a21efb-029e-4fa3-b506-5e3805bc678c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:03.806940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=2 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:03.811964 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e7a21efb-029e-4fa3-b506-5e3805bc678c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:03.812415 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e7a21efb-029e-4fa3-b506-5e3805bc678c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:03.813181 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e7a21efb-029e-4fa3-b506-5e3805bc678c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:03.813619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e7a21efb-029e-4fa3-b506-5e3805bc678c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:03.945709 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e7a21efb-029e-4fa3-b506-5e3805bc678c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:03.953211 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e7a21efb-029e-4fa3-b506-5e3805bc678c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1314 microversion: 2.1 time: 0.154291 Aug 01 14:29:03.953991 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 450/882] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:03 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:04.665178 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c0849605-a476-4427-9648-1eb76bff4370 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:04.665818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c0849605-a476-4427-9648-1eb76bff4370 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:04.672244 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c0849605-a476-4427-9648-1eb76bff4370 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:04.672696 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c0849605-a476-4427-9648-1eb76bff4370 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:04.673461 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c0849605-a476-4427-9648-1eb76bff4370 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:04.673925 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c0849605-a476-4427-9648-1eb76bff4370 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:04.805113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c0849605-a476-4427-9648-1eb76bff4370 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:04.812647 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c0849605-a476-4427-9648-1eb76bff4370 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1567 microversion: 2.1 time: 0.151337 Aug 01 14:29:04.813199 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 433/883] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:04 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:04.974507 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-af653f3a-9ab5-4051-ba57-9d32a45d5547 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:04.975123 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-af653f3a-9ab5-4051-ba57-9d32a45d5547 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:04.981634 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-af653f3a-9ab5-4051-ba57-9d32a45d5547 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:04.982117 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-af653f3a-9ab5-4051-ba57-9d32a45d5547 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:04.982888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-af653f3a-9ab5-4051-ba57-9d32a45d5547 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:04.983332 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-af653f3a-9ab5-4051-ba57-9d32a45d5547 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:05.114813 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-af653f3a-9ab5-4051-ba57-9d32a45d5547 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:05.122081 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-af653f3a-9ab5-4051-ba57-9d32a45d5547 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1314 microversion: 2.1 time: 0.152174 Aug 01 14:29:05.122637 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 451/884] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:04 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:05.833902 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f71c74d9-efe6-45b9-b12a-44633d636245 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:05.834433 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f71c74d9-efe6-45b9-b12a-44633d636245 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:05.840812 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f71c74d9-efe6-45b9-b12a-44633d636245 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:05.841261 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f71c74d9-efe6-45b9-b12a-44633d636245 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:05.842037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f71c74d9-efe6-45b9-b12a-44633d636245 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:05.842473 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f71c74d9-efe6-45b9-b12a-44633d636245 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:05.972322 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f71c74d9-efe6-45b9-b12a-44633d636245 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:05.979844 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f71c74d9-efe6-45b9-b12a-44633d636245 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1567 microversion: 2.1 time: 0.150044 Aug 01 14:29:05.980403 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 434/885] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:05 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:06.142811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6fd3031a-f98e-43b3-8aaf-f749f13b3f8d tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:06.143717 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-6fd3031a-f98e-43b3-8aaf-f749f13b3f8d tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:06.150321 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6fd3031a-f98e-43b3-8aaf-f749f13b3f8d tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:06.150767 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6fd3031a-f98e-43b3-8aaf-f749f13b3f8d tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:06.151523 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6fd3031a-f98e-43b3-8aaf-f749f13b3f8d tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:06.151960 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6fd3031a-f98e-43b3-8aaf-f749f13b3f8d tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:06.284605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6fd3031a-f98e-43b3-8aaf-f749f13b3f8d tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:06.292059 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-6fd3031a-f98e-43b3-8aaf-f749f13b3f8d tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1498 microversion: 2.1 time: 0.153110 Aug 01 14:29:06.292618 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 452/886] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:06 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:07.001630 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-90c154a9-e91e-4ae7-93ee-d5fa31c0442a tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:07.002269 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-90c154a9-e91e-4ae7-93ee-d5fa31c0442a tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:07.010695 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-90c154a9-e91e-4ae7-93ee-d5fa31c0442a tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:07.011143 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-90c154a9-e91e-4ae7-93ee-d5fa31c0442a tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:07.011916 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-90c154a9-e91e-4ae7-93ee-d5fa31c0442a tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:07.012347 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-90c154a9-e91e-4ae7-93ee-d5fa31c0442a tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:07.149495 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-90c154a9-e91e-4ae7-93ee-d5fa31c0442a tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:07.157283 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-90c154a9-e91e-4ae7-93ee-d5fa31c0442a tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1567 microversion: 2.1 time: 0.159635 Aug 01 14:29:07.157888 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 435/887] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:06 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:07.358369 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3a8d0dae-0810-472c-8b56-f42591b1c7ec tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:07.358932 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3a8d0dae-0810-472c-8b56-f42591b1c7ec tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:07.367782 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3a8d0dae-0810-472c-8b56-f42591b1c7ec tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:07.368238 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3a8d0dae-0810-472c-8b56-f42591b1c7ec tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:07.369015 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3a8d0dae-0810-472c-8b56-f42591b1c7ec tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:07.369475 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3a8d0dae-0810-472c-8b56-f42591b1c7ec tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:07.411708 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3a8d0dae-0810-472c-8b56-f42591b1c7ec tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Going to try to terminate instance {{(pid=118247) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:29:07.864893 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3a8d0dae-0810-472c-8b56-f42591b1c7ec tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "DELETE /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 204 len: 0 microversion: 2.1 time: 0.509763 Aug 01 14:29:07.865499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 453/888] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:29:07 2022] DELETE /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:29:07.873976 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3bc989f7-60b0-40c0-9a8d-80aab6b5f553 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:07.874853 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3bc989f7-60b0-40c0-9a8d-80aab6b5f553 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:07.882026 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3bc989f7-60b0-40c0-9a8d-80aab6b5f553 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:07.882488 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3bc989f7-60b0-40c0-9a8d-80aab6b5f553 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:07.883389 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3bc989f7-60b0-40c0-9a8d-80aab6b5f553 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:07.884080 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3bc989f7-60b0-40c0-9a8d-80aab6b5f553 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:07.889559 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:08.047696 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3bc989f7-60b0-40c0-9a8d-80aab6b5f553 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:08.055982 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3bc989f7-60b0-40c0-9a8d-80aab6b5f553 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1504 microversion: 2.1 time: 0.186025 Aug 01 14:29:08.056574 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 436/889] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:07 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:08.184862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-bb8ca311-30c9-4be8-970f-9dcbb529ef3c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:08.185556 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-bb8ca311-30c9-4be8-970f-9dcbb529ef3c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:08.192605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bb8ca311-30c9-4be8-970f-9dcbb529ef3c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:08.193053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bb8ca311-30c9-4be8-970f-9dcbb529ef3c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:08.193848 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bb8ca311-30c9-4be8-970f-9dcbb529ef3c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:08.194287 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bb8ca311-30c9-4be8-970f-9dcbb529ef3c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:08.327849 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bb8ca311-30c9-4be8-970f-9dcbb529ef3c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:08.336258 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-bb8ca311-30c9-4be8-970f-9dcbb529ef3c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1567 microversion: 2.1 time: 0.155539 Aug 01 14:29:08.336820 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 454/890] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:08 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:09.078956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-60d68cc1-101b-45da-9f16-7503ac28ea90 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:09.079493 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-60d68cc1-101b-45da-9f16-7503ac28ea90 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:09.086639 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-60d68cc1-101b-45da-9f16-7503ac28ea90 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:09.087085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-60d68cc1-101b-45da-9f16-7503ac28ea90 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:09.087852 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-60d68cc1-101b-45da-9f16-7503ac28ea90 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:09.088292 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-60d68cc1-101b-45da-9f16-7503ac28ea90 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:09.219874 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-60d68cc1-101b-45da-9f16-7503ac28ea90 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:09.227911 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-60d68cc1-101b-45da-9f16-7503ac28ea90 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1504 microversion: 2.1 time: 0.153206 Aug 01 14:29:09.228467 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 437/891] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:09 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:09.357378 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ff87116f-e73f-4613-a8b2-4670463d726f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:09.358020 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ff87116f-e73f-4613-a8b2-4670463d726f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:09.365232 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ff87116f-e73f-4613-a8b2-4670463d726f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:09.365684 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ff87116f-e73f-4613-a8b2-4670463d726f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:09.366484 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ff87116f-e73f-4613-a8b2-4670463d726f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:09.366930 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ff87116f-e73f-4613-a8b2-4670463d726f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:09.504108 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-ff87116f-e73f-4613-a8b2-4670463d726f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:09.511853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ff87116f-e73f-4613-a8b2-4670463d726f tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1567 microversion: 2.1 time: 0.158525 Aug 01 14:29:09.512416 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 455/892] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:09 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:10.250169 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3ec605e2-3baa-485b-a980-d374a81ed51e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:10.250783 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3ec605e2-3baa-485b-a980-d374a81ed51e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:10.257380 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3ec605e2-3baa-485b-a980-d374a81ed51e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:10.257869 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3ec605e2-3baa-485b-a980-d374a81ed51e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:10.258631 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3ec605e2-3baa-485b-a980-d374a81ed51e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:10.259076 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3ec605e2-3baa-485b-a980-d374a81ed51e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:10.386760 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3ec605e2-3baa-485b-a980-d374a81ed51e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:10.394940 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3ec605e2-3baa-485b-a980-d374a81ed51e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1504 microversion: 2.1 time: 0.148689 Aug 01 14:29:10.395507 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 438/893] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:10 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:10.535081 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7b74bf3e-8d88-43c1-b2fc-5b1f9f452860 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:10.535914 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7b74bf3e-8d88-43c1-b2fc-5b1f9f452860 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:10.542938 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7b74bf3e-8d88-43c1-b2fc-5b1f9f452860 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:10.543391 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7b74bf3e-8d88-43c1-b2fc-5b1f9f452860 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:10.544165 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7b74bf3e-8d88-43c1-b2fc-5b1f9f452860 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:10.544606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7b74bf3e-8d88-43c1-b2fc-5b1f9f452860 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:10.548722 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:10.676553 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7b74bf3e-8d88-43c1-b2fc-5b1f9f452860 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:10.683981 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7b74bf3e-8d88-43c1-b2fc-5b1f9f452860 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1567 microversion: 2.1 time: 0.153995 Aug 01 14:29:10.684539 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 456/894] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:10 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:11.415657 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e05af032-3bdf-48a1-b9a1-f1fb9711d87e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:11.416280 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e05af032-3bdf-48a1-b9a1-f1fb9711d87e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:11.423128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e05af032-3bdf-48a1-b9a1-f1fb9711d87e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:11.423583 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e05af032-3bdf-48a1-b9a1-f1fb9711d87e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:11.424413 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e05af032-3bdf-48a1-b9a1-f1fb9711d87e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:11.424957 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e05af032-3bdf-48a1-b9a1-f1fb9711d87e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:11.569628 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e05af032-3bdf-48a1-b9a1-f1fb9711d87e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:11.591050 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e05af032-3bdf-48a1-b9a1-f1fb9711d87e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1504 microversion: 2.1 time: 0.165683 Aug 01 14:29:11.591050 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 439/895] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:11 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:11.705201 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c1d7b3fb-c60a-436a-b66d-b0e11c31fe4b tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:11.707119 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c1d7b3fb-c60a-436a-b66d-b0e11c31fe4b tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:11.714391 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c1d7b3fb-c60a-436a-b66d-b0e11c31fe4b tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:11.714842 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c1d7b3fb-c60a-436a-b66d-b0e11c31fe4b tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:11.715610 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c1d7b3fb-c60a-436a-b66d-b0e11c31fe4b tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:11.716450 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c1d7b3fb-c60a-436a-b66d-b0e11c31fe4b tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:11.751818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1da08ca9-a1cd-4a0f-8cb4-d4602c595305 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Action: 'create', calling method: .version_select at 0x7fb24eea1b80>, body: {"keypair": {"name": "tempest-keypair-558362281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtjzhFQzCB9ZkYsQ2zB5ZYy6j/LTkLIanjmXnjYm6wCJW1xszsNl5xev73gxRxj7dNnDtAPA3gYZ/z4ch9Dq1RUyPdBdGynhv/Ulpw3Ws/c1wFAkgUBPi10JYSqCtxHFQ=="}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:29:11.770307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-1da08ca9-a1cd-4a0f-8cb4-d4602c595305 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Getting quotas for project c6df4baf0a1242f2b73fe99071682355. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:29:11.774445 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-1da08ca9-a1cd-4a0f-8cb4-d4602c595305 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Getting quotas for user fbb29845a13844f89fd004b401d27b8e and project c6df4baf0a1242f2b73fe99071682355. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:29:11.870820 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-1da08ca9-a1cd-4a0f-8cb4-d4602c595305 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.122820 Aug 01 14:29:11.871428 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 440/896] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Aug 1 14:29:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:29:11.881000 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c1d7b3fb-c60a-436a-b66d-b0e11c31fe4b tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:11.882213 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-172271b5-e30a-4153-8c24-b6231c2f1dbb req-bdea2c21-de0e-42b0-8206-aca304811a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527ad0e8-34b3-462c-b5c2-c8b759bf4dd8", "name": "network-vif-deleted", "tag": "42ece8b2-e2b3-4dff-8b12-50aa1fa64914"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:29:11.889807 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c1d7b3fb-c60a-436a-b66d-b0e11c31fe4b tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1567 microversion: 2.1 time: 0.188362 Aug 01 14:29:11.890763 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 457/897] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:11 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:11.892156 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-172271b5-e30a-4153-8c24-b6231c2f1dbb req-bdea2c21-de0e-42b0-8206-aca304811a4d service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:11.892606 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-172271b5-e30a-4153-8c24-b6231c2f1dbb req-bdea2c21-de0e-42b0-8206-aca304811a4d service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:11.907619 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-172271b5-e30a-4153-8c24-b6231c2f1dbb req-bdea2c21-de0e-42b0-8206-aca304811a4d service nova] Creating event network-vif-deleted:42ece8b2-e2b3-4dff-8b12-50aa1fa64914 for instance 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 on hv-cinder-78729 Aug 01 14:29:11.910920 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-172271b5-e30a-4153-8c24-b6231c2f1dbb req-bdea2c21-de0e-42b0-8206-aca304811a4d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032300 Aug 01 14:29:11.911545 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 441/898] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:29:12.599196 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b2108464-2973-4729-a747-c7c5568897fe tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:12.599843 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b2108464-2973-4729-a747-c7c5568897fe tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:12.606162 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b2108464-2973-4729-a747-c7c5568897fe tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:12.606614 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b2108464-2973-4729-a747-c7c5568897fe tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:12.607382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b2108464-2973-4729-a747-c7c5568897fe tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:12.607817 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b2108464-2973-4729-a747-c7c5568897fe tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:12.639625 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b2108464-2973-4729-a747-c7c5568897fe tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:12.639991 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b2108464-2973-4729-a747-c7c5568897fe tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:12.640438 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-b2108464-2973-4729-a747-c7c5568897fe tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lazy-loading 'fault' on Instance uuid 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:29:12.684749 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-b2108464-2973-4729-a747-c7c5568897fe tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:12.699500 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b2108464-2973-4729-a747-c7c5568897fe tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 200 len: 1304 microversion: 2.1 time: 0.103669 Aug 01 14:29:12.713779 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 458/899] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:12 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:12.914964 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-05cd0bc5-4096-48d7-8c92-077e2721fb15 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:12.915678 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-05cd0bc5-4096-48d7-8c92-077e2721fb15 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:12.922411 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-05cd0bc5-4096-48d7-8c92-077e2721fb15 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:12.922966 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-05cd0bc5-4096-48d7-8c92-077e2721fb15 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:12.923980 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-05cd0bc5-4096-48d7-8c92-077e2721fb15 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:12.925020 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-05cd0bc5-4096-48d7-8c92-077e2721fb15 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:13.003781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-1b192d4f-fdbc-48d1-a7d0-1eb64cf41df2 req-65e5889a-a717-4854-8bdb-a4487c2d1fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4551bd54-cfbb-4d79-913e-6380a1e0f5f1", "name": "network-vif-unplugged", "status": "completed", "tag": "2824ee5e-b738-4db9-80e9-f6a993f7e7af"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:29:13.016582 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-1b192d4f-fdbc-48d1-a7d0-1eb64cf41df2 req-65e5889a-a717-4854-8bdb-a4487c2d1fde service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:13.016582 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-1b192d4f-fdbc-48d1-a7d0-1eb64cf41df2 req-65e5889a-a717-4854-8bdb-a4487c2d1fde service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:13.029026 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-1b192d4f-fdbc-48d1-a7d0-1eb64cf41df2 req-65e5889a-a717-4854-8bdb-a4487c2d1fde service nova] Creating event network-vif-unplugged:2824ee5e-b738-4db9-80e9-f6a993f7e7af for instance 4551bd54-cfbb-4d79-913e-6380a1e0f5f1 on hv-cinder-78729 Aug 01 14:29:13.035111 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-1b192d4f-fdbc-48d1-a7d0-1eb64cf41df2 req-65e5889a-a717-4854-8bdb-a4487c2d1fde service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035372 Aug 01 14:29:13.036317 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 459/900] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:29:13.066802 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-05cd0bc5-4096-48d7-8c92-077e2721fb15 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:13.074569 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-05cd0bc5-4096-48d7-8c92-077e2721fb15 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1568 microversion: 2.1 time: 0.165526 Aug 01 14:29:13.075137 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 442/901] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:12 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:13.103323 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-5676935b-0ce8-4a41-a496-8d268c656ce9 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:29:13.104247 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-5676935b-0ce8-4a41-a496-8d268c656ce9 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:13.110925 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5676935b-0ce8-4a41-a496-8d268c656ce9 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:13.111686 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5676935b-0ce8-4a41-a496-8d268c656ce9 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:13.113407 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5676935b-0ce8-4a41-a496-8d268c656ce9 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:13.113965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5676935b-0ce8-4a41-a496-8d268c656ce9 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:13.145977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-5676935b-0ce8-4a41-a496-8d268c656ce9 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118247) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 14:29:13.497738 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-5676935b-0ce8-4a41-a496-8d268c656ce9 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "POST /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1/action" status: 202 len: 0 microversion: 2.1 time: 0.395081 Aug 01 14:29:13.497738 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 460/902] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Aug 1 14:29:13 2022] POST /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:29:13.504998 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-58d65a1c-0e32-4951-919f-2f1842d60707 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:13.505684 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-58d65a1c-0e32-4951-919f-2f1842d60707 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:13.512943 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-58d65a1c-0e32-4951-919f-2f1842d60707 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:13.514438 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-58d65a1c-0e32-4951-919f-2f1842d60707 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:13.514556 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-58d65a1c-0e32-4951-919f-2f1842d60707 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:13.514951 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-58d65a1c-0e32-4951-919f-2f1842d60707 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:13.692015 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-58d65a1c-0e32-4951-919f-2f1842d60707 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:13.700842 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-58d65a1c-0e32-4951-919f-2f1842d60707 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1516 microversion: 2.1 time: 0.201391 Aug 01 14:29:13.701404 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 443/903] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:13 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1516 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:13.722741 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-757a0ed8-3b4e-4f26-b90e-624a307d1b13 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:13.723885 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-757a0ed8-3b4e-4f26-b90e-624a307d1b13 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:13.730276 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-757a0ed8-3b4e-4f26-b90e-624a307d1b13 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:13.730736 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-757a0ed8-3b4e-4f26-b90e-624a307d1b13 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:13.731523 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-757a0ed8-3b4e-4f26-b90e-624a307d1b13 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:13.731987 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-757a0ed8-3b4e-4f26-b90e-624a307d1b13 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:13.747421 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-757a0ed8-3b4e-4f26-b90e-624a307d1b13 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] HTTP exception thrown: Instance 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 could not be found. Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-757a0ed8-3b4e-4f26-b90e-624a307d1b13 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Request method failure captured: Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 HTTP/1.1 Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-MiaUTaSKor-1C0tiohbt-sZNTSO7flb71qligGTAEiQLGIfoBAKjfMygA2h8Z-fX1ytu-twNmgujGqHaPlx4BJ4N_hmyCCGrm8CnjMACD-gejHZiLkJwgV_e3YQSjZHzxlpYdFoBAynHqX-U6qUh9GCxaCjze0Xw9vHN-1ed3y7oY Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: 1d3ebdfb4edd4ba1ad6438a68e325219 Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-VolumesActionsTest-186907533 Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:29:13.750867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:29:13.752305 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d3ebdfb4edd4ba1ad6438a68e325219"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d3ebdfb4edd4ba1ad6438a68e325219"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d3ebdfb4edd4ba1ad6438a68e325219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d3ebdfb4edd4ba1ad6438a68e325219"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:29:13.752305 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-VolumesActionsTest-186907533 Aug 01 14:29:13.752305 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: 1d3ebdfb4edd4ba1ad6438a68e325219 Aug 01 14:29:13.752305 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-VolumesActionsTest-186907533 Aug 01 14:29:13.752305 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-VolumesActionsTest-186907533-project Aug 01 14:29:13.752305 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:29:13.752305 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:29:13.752305 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: 3c12318332b64ca1b1b9937852215eaa Aug 01 14:29:13.752305 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-VolumesActionsTest-186907533-project Aug 01 14:29:13.752305 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:29:13.752305 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 could not be found. Aug 01 14:29:13.752305 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '527ad0e8-34b3-462c-b5c2-c8b759bf4dd8'} Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 could not be found. Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:29:13.753940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 could not be found. Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 could not be found. Aug 01 14:29:13.755607 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:29:13.757430 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-757a0ed8-3b4e-4f26-b90e-624a307d1b13 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Returning 404 to user: Instance 527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:29:13.757430 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-757a0ed8-3b4e-4f26-b90e-624a307d1b13 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8" status: 404 len: 111 microversion: 2.1 time: 0.031735 Aug 01 14:29:13.757430 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 461/904] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:13 2022] GET /compute/v2.1/servers/527ad0e8-34b3-462c-b5c2-c8b759bf4dd8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:29:13.807649 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d786a071-3faa-464d-8a32-eb9898057ee1 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-781053075", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452", "networks": [{"uuid": "9dbe0bb1-fc8d-48d5-83fe-cb294b52d367"}]}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:29:13.869806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.network.neutron [None req-d786a071-3faa-464d-8a32-eb9898057ee1 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] validate_networks() for [('9dbe0bb1-fc8d-48d5-83fe-cb294b52d367', None, None, None, None, None)] {{(pid=118246) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:29:14.492250 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-d786a071-3faa-464d-8a32-eb9898057ee1 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Flavor limits 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:29:14.492858 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-d786a071-3faa-464d-8a32-eb9898057ee1 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Image limits 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:29:14.493194 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-d786a071-3faa-464d-8a32-eb9898057ee1 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Flavor pref 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:29:14.493612 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-d786a071-3faa-464d-8a32-eb9898057ee1 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Image pref 0:0:0 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:29:14.494082 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.virt.hardware [None req-d786a071-3faa-464d-8a32-eb9898057ee1 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118246) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:29:14.504790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d786a071-3faa-464d-8a32-eb9898057ee1 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:14.505490 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d786a071-3faa-464d-8a32-eb9898057ee1 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:14.506589 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d786a071-3faa-464d-8a32-eb9898057ee1 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:14.507061 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d786a071-3faa-464d-8a32-eb9898057ee1 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:14.525176 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-d786a071-3faa-464d-8a32-eb9898057ee1 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Getting quotas for project 1d3ebdfb4edd4ba1ad6438a68e325219. Resources: {'ram', 'cores', 'instances'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:29:14.529422 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-d786a071-3faa-464d-8a32-eb9898057ee1 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Getting quotas for user 3c12318332b64ca1b1b9937852215eaa and project 1d3ebdfb4edd4ba1ad6438a68e325219. Resources: {'ram', 'cores', 'instances'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:29:14.533795 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a81ce020-a160-4800-b1b4-3ab3e8abf8c7 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1238302126", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34cc3867-be64-4b6c-a790-8e0e66fb7fc3"}], "security_groups": [{"name": "tempest-securitygroup--1816447680"}], "key_name": "tempest-keypair-558362281", "user_data": "}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:29:14.541560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d786a071-3faa-464d-8a32-eb9898057ee1 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Going to run 1 instances... {{(pid=118246) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:29:14.543901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d786a071-3faa-464d-8a32-eb9898057ee1 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118246) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:29:14.641956 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.network.neutron [None req-a81ce020-a160-4800-b1b4-3ab3e8abf8c7 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] validate_networks() for [('34cc3867-be64-4b6c-a790-8e0e66fb7fc3', None, None, None, None, None)] {{(pid=118247) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:29:14.684211 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d786a071-3faa-464d-8a32-eb9898057ee1 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880322 Aug 01 14:29:14.684935 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 444/905] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:29:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:29:14.696315 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-30aae3c7-3166-421f-b1d5-03914fc72937 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:14.697245 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-30aae3c7-3166-421f-b1d5-03914fc72937 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:14.765044 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-30aae3c7-3166-421f-b1d5-03914fc72937 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:14.786913 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-30aae3c7-3166-421f-b1d5-03914fc72937 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1213 microversion: 2.1 time: 0.080350 Aug 01 14:29:14.786913 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 445/906] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:14 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:29:14.786913 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7756ca3e-6e34-4c4b-9a4c-aa00f26a1c55 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:14.786913 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7756ca3e-6e34-4c4b-9a4c-aa00f26a1c55 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:14.786913 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7756ca3e-6e34-4c4b-9a4c-aa00f26a1c55 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:14.787452 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7756ca3e-6e34-4c4b-9a4c-aa00f26a1c55 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:14.787452 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7756ca3e-6e34-4c4b-9a4c-aa00f26a1c55 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:14.787730 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7756ca3e-6e34-4c4b-9a4c-aa00f26a1c55 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:15.023707 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7756ca3e-6e34-4c4b-9a4c-aa00f26a1c55 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:15.031999 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7756ca3e-6e34-4c4b-9a4c-aa00f26a1c55 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1518 microversion: 2.1 time: 0.257449 Aug 01 14:29:15.033049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 446/907] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:14 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1518 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:15.146400 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-a81ce020-a160-4800-b1b4-3ab3e8abf8c7 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Flavor limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:29:15.146873 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-a81ce020-a160-4800-b1b4-3ab3e8abf8c7 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Image limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:29:15.147308 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-a81ce020-a160-4800-b1b4-3ab3e8abf8c7 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Flavor pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:29:15.147719 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-a81ce020-a160-4800-b1b4-3ab3e8abf8c7 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Image pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:29:15.148129 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-a81ce020-a160-4800-b1b4-3ab3e8abf8c7 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:29:15.157035 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a81ce020-a160-4800-b1b4-3ab3e8abf8c7 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:15.157499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a81ce020-a160-4800-b1b4-3ab3e8abf8c7 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:15.158348 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a81ce020-a160-4800-b1b4-3ab3e8abf8c7 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:15.158961 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a81ce020-a160-4800-b1b4-3ab3e8abf8c7 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:15.175237 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-a81ce020-a160-4800-b1b4-3ab3e8abf8c7 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Getting quotas for project c6df4baf0a1242f2b73fe99071682355. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:29:15.179123 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-a81ce020-a160-4800-b1b4-3ab3e8abf8c7 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Getting quotas for user fbb29845a13844f89fd004b401d27b8e and project c6df4baf0a1242f2b73fe99071682355. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:29:15.191183 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a81ce020-a160-4800-b1b4-3ab3e8abf8c7 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Going to run 1 instances... {{(pid=118247) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:29:15.193678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a81ce020-a160-4800-b1b4-3ab3e8abf8c7 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118247) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:29:15.432063 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a81ce020-a160-4800-b1b4-3ab3e8abf8c7 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.904248 Aug 01 14:29:15.433059 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 462/908] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:29:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 14:29:15.444542 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-fef30f3f-9649-414d-930c-77ea82d26bf9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:15.445391 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-fef30f3f-9649-414d-930c-77ea82d26bf9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:15.501774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-fef30f3f-9649-414d-930c-77ea82d26bf9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:15.510004 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-fef30f3f-9649-414d-930c-77ea82d26bf9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1241 microversion: 2.1 time: 0.069854 Aug 01 14:29:15.510594 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 447/909] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:15 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:15.794954 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0874c717-9234-4a66-85d7-31980a1d821e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:15.795568 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0874c717-9234-4a66-85d7-31980a1d821e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:15.801725 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0874c717-9234-4a66-85d7-31980a1d821e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:15.802199 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0874c717-9234-4a66-85d7-31980a1d821e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:15.802952 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0874c717-9234-4a66-85d7-31980a1d821e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:15.803388 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0874c717-9234-4a66-85d7-31980a1d821e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:15.880087 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0874c717-9234-4a66-85d7-31980a1d821e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:15.887631 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0874c717-9234-4a66-85d7-31980a1d821e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1217 microversion: 2.1 time: 0.096957 Aug 01 14:29:15.888194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 463/910] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:15 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:16.054926 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0296372b-0479-4736-8e2b-c9d602fc0428 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:16.055542 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0296372b-0479-4736-8e2b-c9d602fc0428 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:16.064475 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0296372b-0479-4736-8e2b-c9d602fc0428 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:16.065377 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0296372b-0479-4736-8e2b-c9d602fc0428 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:16.065896 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0296372b-0479-4736-8e2b-c9d602fc0428 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:16.066338 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0296372b-0479-4736-8e2b-c9d602fc0428 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:16.209853 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-0296372b-0479-4736-8e2b-c9d602fc0428 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:16.217362 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0296372b-0479-4736-8e2b-c9d602fc0428 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1518 microversion: 2.1 time: 0.166467 Aug 01 14:29:16.217948 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 448/911] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:16 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:29:16.530562 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-45b05442-1ca8-4cf2-9034-9daa22798b02 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:16.531182 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-45b05442-1ca8-4cf2-9034-9daa22798b02 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:16.537923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-45b05442-1ca8-4cf2-9034-9daa22798b02 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:16.538375 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-45b05442-1ca8-4cf2-9034-9daa22798b02 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:16.539175 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-45b05442-1ca8-4cf2-9034-9daa22798b02 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:16.539612 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-45b05442-1ca8-4cf2-9034-9daa22798b02 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:16.601170 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-45b05442-1ca8-4cf2-9034-9daa22798b02 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:16.608872 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-45b05442-1ca8-4cf2-9034-9daa22798b02 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1245 microversion: 2.1 time: 0.082105 Aug 01 14:29:16.609438 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 464/912] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:16 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:16.909345 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7bf03888-b572-4243-9ea8-ece81031d5c6 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:16.910126 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7bf03888-b572-4243-9ea8-ece81031d5c6 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:16.916470 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7bf03888-b572-4243-9ea8-ece81031d5c6 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:16.916931 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7bf03888-b572-4243-9ea8-ece81031d5c6 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:16.917886 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7bf03888-b572-4243-9ea8-ece81031d5c6 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:16.918329 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7bf03888-b572-4243-9ea8-ece81031d5c6 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:16.983812 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7bf03888-b572-4243-9ea8-ece81031d5c6 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:16.992595 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7bf03888-b572-4243-9ea8-ece81031d5c6 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1265 microversion: 2.1 time: 0.088156 Aug 01 14:29:16.993358 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 449/913] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:16 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:17.239953 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-29419cb1-168c-4291-8f1b-c1ffe5b726ba tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:17.240455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-29419cb1-168c-4291-8f1b-c1ffe5b726ba tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:17.247463 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-29419cb1-168c-4291-8f1b-c1ffe5b726ba tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:17.247906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-29419cb1-168c-4291-8f1b-c1ffe5b726ba tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:17.248678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-29419cb1-168c-4291-8f1b-c1ffe5b726ba tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:17.249111 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-29419cb1-168c-4291-8f1b-c1ffe5b726ba tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:17.398913 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-29419cb1-168c-4291-8f1b-c1ffe5b726ba tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:17.407321 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-29419cb1-168c-4291-8f1b-c1ffe5b726ba tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1574 microversion: 2.1 time: 0.172632 Aug 01 14:29:17.408452 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 465/914] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:17 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:17.632804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e0218f11-3f9f-4dd5-b032-d5f4ebe3fd1a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:17.633417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e0218f11-3f9f-4dd5-b032-d5f4ebe3fd1a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:17.637389 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:17.641217 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e0218f11-3f9f-4dd5-b032-d5f4ebe3fd1a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:17.641825 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e0218f11-3f9f-4dd5-b032-d5f4ebe3fd1a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:17.642630 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e0218f11-3f9f-4dd5-b032-d5f4ebe3fd1a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:17.643074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e0218f11-3f9f-4dd5-b032-d5f4ebe3fd1a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:17.711717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e0218f11-3f9f-4dd5-b032-d5f4ebe3fd1a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:17.719275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e0218f11-3f9f-4dd5-b032-d5f4ebe3fd1a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1293 microversion: 2.1 time: 0.092746 Aug 01 14:29:17.719840 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 450/915] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:17 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:18.016034 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-cfcffe66-7c9c-409e-959a-cca230b09aac tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:18.016641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-cfcffe66-7c9c-409e-959a-cca230b09aac tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:18.023062 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cfcffe66-7c9c-409e-959a-cca230b09aac tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:18.023520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cfcffe66-7c9c-409e-959a-cca230b09aac tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:18.024329 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cfcffe66-7c9c-409e-959a-cca230b09aac tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:18.024772 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cfcffe66-7c9c-409e-959a-cca230b09aac tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:18.090582 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-cfcffe66-7c9c-409e-959a-cca230b09aac tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:18.098896 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-cfcffe66-7c9c-409e-959a-cca230b09aac tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1271 microversion: 2.1 time: 0.087383 Aug 01 14:29:18.099469 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 466/916] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:18 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:18.429953 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-63bdb56b-46eb-4d1b-b8a6-76485656e313 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:18.430662 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-63bdb56b-46eb-4d1b-b8a6-76485656e313 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:18.438069 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-63bdb56b-46eb-4d1b-b8a6-76485656e313 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:18.438527 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-63bdb56b-46eb-4d1b-b8a6-76485656e313 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:18.439310 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-63bdb56b-46eb-4d1b-b8a6-76485656e313 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:18.439923 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-63bdb56b-46eb-4d1b-b8a6-76485656e313 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:18.583446 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-63bdb56b-46eb-4d1b-b8a6-76485656e313 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:18.591389 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-63bdb56b-46eb-4d1b-b8a6-76485656e313 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1574 microversion: 2.1 time: 0.166749 Aug 01 14:29:18.592258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 451/917] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:18 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:18.741140 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-057679e1-5626-4d7b-a930-aaa1993c1b01 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:18.741775 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-057679e1-5626-4d7b-a930-aaa1993c1b01 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:18.748224 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-057679e1-5626-4d7b-a930-aaa1993c1b01 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:18.748674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-057679e1-5626-4d7b-a930-aaa1993c1b01 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:18.749434 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-057679e1-5626-4d7b-a930-aaa1993c1b01 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:18.750172 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-057679e1-5626-4d7b-a930-aaa1993c1b01 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:18.814628 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-057679e1-5626-4d7b-a930-aaa1993c1b01 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:18.822672 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-057679e1-5626-4d7b-a930-aaa1993c1b01 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1299 microversion: 2.1 time: 0.086079 Aug 01 14:29:18.823235 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 467/918] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:18 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:19.120826 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-474a931a-9ab6-424e-b28e-7623082489ba tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:19.121440 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-474a931a-9ab6-424e-b28e-7623082489ba tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:19.128239 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-474a931a-9ab6-424e-b28e-7623082489ba tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:19.128627 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-474a931a-9ab6-424e-b28e-7623082489ba tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:19.129413 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-474a931a-9ab6-424e-b28e-7623082489ba tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:19.129907 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-474a931a-9ab6-424e-b28e-7623082489ba tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:19.263012 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-474a931a-9ab6-424e-b28e-7623082489ba tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:19.271639 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-474a931a-9ab6-424e-b28e-7623082489ba tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1313 microversion: 2.1 time: 0.154761 Aug 01 14:29:19.272210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 452/919] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:19 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:19.613830 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d183bf4b-6b9d-4c23-a3b3-997636915742 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:19.614892 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d183bf4b-6b9d-4c23-a3b3-997636915742 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:19.627248 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d183bf4b-6b9d-4c23-a3b3-997636915742 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:19.627766 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d183bf4b-6b9d-4c23-a3b3-997636915742 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:19.629024 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d183bf4b-6b9d-4c23-a3b3-997636915742 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:19.629149 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d183bf4b-6b9d-4c23-a3b3-997636915742 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:19.776926 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d183bf4b-6b9d-4c23-a3b3-997636915742 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:19.785192 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d183bf4b-6b9d-4c23-a3b3-997636915742 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1574 microversion: 2.1 time: 0.176504 Aug 01 14:29:19.785888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 468/920] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:19 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:19.845004 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1534a162-c464-42f6-bb4c-25d15d0b9587 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:19.846288 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-1534a162-c464-42f6-bb4c-25d15d0b9587 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:19.853638 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1534a162-c464-42f6-bb4c-25d15d0b9587 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:19.854240 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1534a162-c464-42f6-bb4c-25d15d0b9587 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:19.855260 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1534a162-c464-42f6-bb4c-25d15d0b9587 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:19.855974 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1534a162-c464-42f6-bb4c-25d15d0b9587 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:19.992018 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-1534a162-c464-42f6-bb4c-25d15d0b9587 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:19.999528 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-1534a162-c464-42f6-bb4c-25d15d0b9587 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1367 microversion: 2.1 time: 0.159044 Aug 01 14:29:20.000187 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 453/921] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:19 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:20.208955 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-a6b8b607-89d5-43fa-a6c1-17c6b084b0b7 req-3c6130e6-d6a4-4de4-8585-35b0badd115b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5183ce-e06a-4359-93fa-e3a38b6b5cfe", "tag": "f51f7d1e-a2ab-4fe3-b803-d062f30cddc3"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:29:20.218794 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-a6b8b607-89d5-43fa-a6c1-17c6b084b0b7 req-3c6130e6-d6a4-4de4-8585-35b0badd115b service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:20.219604 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-a6b8b607-89d5-43fa-a6c1-17c6b084b0b7 req-3c6130e6-d6a4-4de4-8585-35b0badd115b service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:20.232898 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-a6b8b607-89d5-43fa-a6c1-17c6b084b0b7 req-3c6130e6-d6a4-4de4-8585-35b0badd115b service nova] Creating event network-changed:f51f7d1e-a2ab-4fe3-b803-d062f30cddc3 for instance 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe on hv-cinder-78729 Aug 01 14:29:20.238578 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-a6b8b607-89d5-43fa-a6c1-17c6b084b0b7 req-3c6130e6-d6a4-4de4-8585-35b0badd115b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032733 Aug 01 14:29:20.239731 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 469/922] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:29:20.294447 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d1e3c256-3e48-4e31-9385-6db63f6433a6 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:20.295104 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d1e3c256-3e48-4e31-9385-6db63f6433a6 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:20.307023 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d1e3c256-3e48-4e31-9385-6db63f6433a6 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:20.307023 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d1e3c256-3e48-4e31-9385-6db63f6433a6 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:20.307023 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d1e3c256-3e48-4e31-9385-6db63f6433a6 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:20.307023 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d1e3c256-3e48-4e31-9385-6db63f6433a6 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:20.436383 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d1e3c256-3e48-4e31-9385-6db63f6433a6 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:20.444753 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d1e3c256-3e48-4e31-9385-6db63f6433a6 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1313 microversion: 2.1 time: 0.155434 Aug 01 14:29:20.445449 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 454/923] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:20 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:20.808167 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0bc11bae-aa19-4be9-acaa-aeb23bd2ecd1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:20.808943 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0bc11bae-aa19-4be9-acaa-aeb23bd2ecd1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:20.816128 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0bc11bae-aa19-4be9-acaa-aeb23bd2ecd1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:20.816673 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0bc11bae-aa19-4be9-acaa-aeb23bd2ecd1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:20.817612 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0bc11bae-aa19-4be9-acaa-aeb23bd2ecd1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:20.818075 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0bc11bae-aa19-4be9-acaa-aeb23bd2ecd1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:20.958406 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0bc11bae-aa19-4be9-acaa-aeb23bd2ecd1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:20.965959 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0bc11bae-aa19-4be9-acaa-aeb23bd2ecd1 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1574 microversion: 2.1 time: 0.162667 Aug 01 14:29:20.966527 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 470/924] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:20 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:21.021440 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-aedef520-0942-4771-97de-e055f367a988 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:21.022020 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-aedef520-0942-4771-97de-e055f367a988 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:21.028071 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-aedef520-0942-4771-97de-e055f367a988 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:21.028522 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-aedef520-0942-4771-97de-e055f367a988 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:21.029286 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-aedef520-0942-4771-97de-e055f367a988 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:21.029726 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-aedef520-0942-4771-97de-e055f367a988 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:21.162774 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-aedef520-0942-4771-97de-e055f367a988 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:21.170464 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-aedef520-0942-4771-97de-e055f367a988 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1367 microversion: 2.1 time: 0.153583 Aug 01 14:29:21.171048 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 455/925] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:21 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:29:21.466764 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-bab626f2-7d7d-4fbf-b55d-08d198382408 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:21.467440 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-bab626f2-7d7d-4fbf-b55d-08d198382408 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:21.474902 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bab626f2-7d7d-4fbf-b55d-08d198382408 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:21.475351 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bab626f2-7d7d-4fbf-b55d-08d198382408 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:21.476115 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bab626f2-7d7d-4fbf-b55d-08d198382408 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:21.476548 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bab626f2-7d7d-4fbf-b55d-08d198382408 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:21.613828 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bab626f2-7d7d-4fbf-b55d-08d198382408 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:21.622137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-bab626f2-7d7d-4fbf-b55d-08d198382408 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1313 microversion: 2.1 time: 0.159453 Aug 01 14:29:21.622710 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 471/926] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:21 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:21.987972 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c69e9536-e692-4b5e-9b95-5bcf5cb154d6 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:21.988598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c69e9536-e692-4b5e-9b95-5bcf5cb154d6 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:21.995343 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c69e9536-e692-4b5e-9b95-5bcf5cb154d6 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:21.998419 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c69e9536-e692-4b5e-9b95-5bcf5cb154d6 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:21.998419 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c69e9536-e692-4b5e-9b95-5bcf5cb154d6 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:21.998419 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c69e9536-e692-4b5e-9b95-5bcf5cb154d6 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:22.128405 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c69e9536-e692-4b5e-9b95-5bcf5cb154d6 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:22.136033 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c69e9536-e692-4b5e-9b95-5bcf5cb154d6 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1574 microversion: 2.1 time: 0.152547 Aug 01 14:29:22.136596 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 456/927] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:21 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:29:22.191780 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-fad9dfa1-32a9-46e7-9fa8-86ccf87258c4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:22.192326 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-fad9dfa1-32a9-46e7-9fa8-86ccf87258c4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:22.198419 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fad9dfa1-32a9-46e7-9fa8-86ccf87258c4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:22.198874 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fad9dfa1-32a9-46e7-9fa8-86ccf87258c4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:22.199644 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fad9dfa1-32a9-46e7-9fa8-86ccf87258c4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:22.200087 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fad9dfa1-32a9-46e7-9fa8-86ccf87258c4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:22.257415 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-9932cefe-79bb-4477-95f1-9ea9b0eda09a req-ee8d79bf-1f4d-4f88-b31a-a4a67649ce74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a608434-236b-4efe-82ff-2abf4d225423", "tag": "330786e5-cb80-48fd-b4d6-d814d3922c64"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:29:22.266976 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-9932cefe-79bb-4477-95f1-9ea9b0eda09a req-ee8d79bf-1f4d-4f88-b31a-a4a67649ce74 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:22.267428 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-9932cefe-79bb-4477-95f1-9ea9b0eda09a req-ee8d79bf-1f4d-4f88-b31a-a4a67649ce74 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:22.271939 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=100 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:22.279964 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-9932cefe-79bb-4477-95f1-9ea9b0eda09a req-ee8d79bf-1f4d-4f88-b31a-a4a67649ce74 service nova] Creating event network-changed:330786e5-cb80-48fd-b4d6-d814d3922c64 for instance 6a608434-236b-4efe-82ff-2abf4d225423 on hv-cinder-78729 Aug 01 14:29:22.286955 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-9932cefe-79bb-4477-95f1-9ea9b0eda09a req-ee8d79bf-1f4d-4f88-b31a-a4a67649ce74 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031161 Aug 01 14:29:22.286955 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 457/928] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:29:22.332305 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-fad9dfa1-32a9-46e7-9fa8-86ccf87258c4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:22.340154 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-fad9dfa1-32a9-46e7-9fa8-86ccf87258c4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1367 microversion: 2.1 time: 0.152591 Aug 01 14:29:22.340712 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 472/929] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:22 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:22.644501 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0c2a71bd-c040-4858-a1a7-d0eff7924c74 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:22.645242 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0c2a71bd-c040-4858-a1a7-d0eff7924c74 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:22.651468 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0c2a71bd-c040-4858-a1a7-d0eff7924c74 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:22.651948 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0c2a71bd-c040-4858-a1a7-d0eff7924c74 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:22.652711 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0c2a71bd-c040-4858-a1a7-d0eff7924c74 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:22.653147 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0c2a71bd-c040-4858-a1a7-d0eff7924c74 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:22.783074 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-0c2a71bd-c040-4858-a1a7-d0eff7924c74 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:22.791547 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0c2a71bd-c040-4858-a1a7-d0eff7924c74 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1313 microversion: 2.1 time: 0.151619 Aug 01 14:29:22.792401 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 458/930] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:22 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:23.157798 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-29f7feeb-7238-4baa-bdc5-4eaabfe632bf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:23.158418 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-29f7feeb-7238-4baa-bdc5-4eaabfe632bf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:23.161313 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:23.166131 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-29f7feeb-7238-4baa-bdc5-4eaabfe632bf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:23.166592 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-29f7feeb-7238-4baa-bdc5-4eaabfe632bf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:23.167362 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-29f7feeb-7238-4baa-bdc5-4eaabfe632bf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:23.167806 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-29f7feeb-7238-4baa-bdc5-4eaabfe632bf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:23.297102 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-29f7feeb-7238-4baa-bdc5-4eaabfe632bf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:23.304722 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-29f7feeb-7238-4baa-bdc5-4eaabfe632bf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1574 microversion: 2.1 time: 0.150779 Aug 01 14:29:23.305283 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 473/931] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:23 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:23.361857 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-19f1fdcc-97fe-4d60-9ee4-4a5f3d8db5da tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:23.362928 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-19f1fdcc-97fe-4d60-9ee4-4a5f3d8db5da tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:23.369838 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-19f1fdcc-97fe-4d60-9ee4-4a5f3d8db5da tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:23.370229 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-19f1fdcc-97fe-4d60-9ee4-4a5f3d8db5da tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:23.370993 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-19f1fdcc-97fe-4d60-9ee4-4a5f3d8db5da tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:23.371422 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-19f1fdcc-97fe-4d60-9ee4-4a5f3d8db5da tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:23.509341 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-19f1fdcc-97fe-4d60-9ee4-4a5f3d8db5da tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:23.517077 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-19f1fdcc-97fe-4d60-9ee4-4a5f3d8db5da tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1367 microversion: 2.1 time: 0.159093 Aug 01 14:29:23.517645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 459/932] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:23 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:23.814172 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f9a728ce-b939-4bbb-bd0d-cb8d8e8ff503 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:23.814848 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f9a728ce-b939-4bbb-bd0d-cb8d8e8ff503 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:23.821602 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f9a728ce-b939-4bbb-bd0d-cb8d8e8ff503 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:23.822087 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f9a728ce-b939-4bbb-bd0d-cb8d8e8ff503 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:23.822859 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f9a728ce-b939-4bbb-bd0d-cb8d8e8ff503 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:23.823296 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f9a728ce-b939-4bbb-bd0d-cb8d8e8ff503 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:23.827169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:23.953374 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f9a728ce-b939-4bbb-bd0d-cb8d8e8ff503 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:23.960696 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f9a728ce-b939-4bbb-bd0d-cb8d8e8ff503 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1313 microversion: 2.1 time: 0.150392 Aug 01 14:29:23.961251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 474/933] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:23 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:24.326162 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b13568f2-1085-40ba-ac85-e7186116757a tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:24.326775 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b13568f2-1085-40ba-ac85-e7186116757a tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:24.333342 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b13568f2-1085-40ba-ac85-e7186116757a tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:24.333884 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b13568f2-1085-40ba-ac85-e7186116757a tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:24.334649 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b13568f2-1085-40ba-ac85-e7186116757a tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:24.335090 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b13568f2-1085-40ba-ac85-e7186116757a tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:24.467128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-b13568f2-1085-40ba-ac85-e7186116757a tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:24.475777 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b13568f2-1085-40ba-ac85-e7186116757a tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1574 microversion: 2.1 time: 0.153443 Aug 01 14:29:24.476336 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 460/934] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:24 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:24.541015 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-771884f7-520b-4162-ab21-b48fde7ea152 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:24.541656 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-771884f7-520b-4162-ab21-b48fde7ea152 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:24.548304 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-771884f7-520b-4162-ab21-b48fde7ea152 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:24.548755 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-771884f7-520b-4162-ab21-b48fde7ea152 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:24.549519 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-771884f7-520b-4162-ab21-b48fde7ea152 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:24.550495 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-771884f7-520b-4162-ab21-b48fde7ea152 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:24.677403 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-771884f7-520b-4162-ab21-b48fde7ea152 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:24.685219 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-771884f7-520b-4162-ab21-b48fde7ea152 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1367 microversion: 2.1 time: 0.148019 Aug 01 14:29:24.685898 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 475/935] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:24 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:24.982137 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-94fb4744-36a5-49ba-aa3b-b1c737704480 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:24.982749 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-94fb4744-36a5-49ba-aa3b-b1c737704480 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:24.984677 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=2 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:24.990721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-94fb4744-36a5-49ba-aa3b-b1c737704480 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:24.991174 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-94fb4744-36a5-49ba-aa3b-b1c737704480 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:24.991996 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-94fb4744-36a5-49ba-aa3b-b1c737704480 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:24.992441 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-94fb4744-36a5-49ba-aa3b-b1c737704480 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:25.122769 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-94fb4744-36a5-49ba-aa3b-b1c737704480 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:25.130538 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-94fb4744-36a5-49ba-aa3b-b1c737704480 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1313 microversion: 2.1 time: 0.152229 Aug 01 14:29:25.131115 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 461/936] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:24 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:25.496704 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-9236833f-6753-4e51-b8dc-a596a3360216 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:25.497238 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-9236833f-6753-4e51-b8dc-a596a3360216 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:25.499128 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=2 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:25.499803 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=6 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:25.505677 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9236833f-6753-4e51-b8dc-a596a3360216 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:25.505845 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9236833f-6753-4e51-b8dc-a596a3360216 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:25.506688 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9236833f-6753-4e51-b8dc-a596a3360216 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:25.507130 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9236833f-6753-4e51-b8dc-a596a3360216 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:25.645104 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-9236833f-6753-4e51-b8dc-a596a3360216 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:25.652774 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-9236833f-6753-4e51-b8dc-a596a3360216 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1574 microversion: 2.1 time: 0.160199 Aug 01 14:29:25.653336 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 476/937] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:25 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:25.708197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7499f293-7479-41bd-971b-202df9b9c4e2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:25.708811 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7499f293-7479-41bd-971b-202df9b9c4e2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:25.711146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=14 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:25.715999 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7499f293-7479-41bd-971b-202df9b9c4e2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:25.716402 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7499f293-7479-41bd-971b-202df9b9c4e2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:25.717169 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7499f293-7479-41bd-971b-202df9b9c4e2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:25.717608 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7499f293-7479-41bd-971b-202df9b9c4e2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:25.849700 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7499f293-7479-41bd-971b-202df9b9c4e2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:25.857741 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7499f293-7479-41bd-971b-202df9b9c4e2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1367 microversion: 2.1 time: 0.154199 Aug 01 14:29:25.858316 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 462/938] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:25 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:26.151690 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e8555d77-2598-41cd-a130-41786bdb8fd5 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:26.152302 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e8555d77-2598-41cd-a130-41786bdb8fd5 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:26.159103 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e8555d77-2598-41cd-a130-41786bdb8fd5 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:26.159558 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e8555d77-2598-41cd-a130-41786bdb8fd5 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:26.160844 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e8555d77-2598-41cd-a130-41786bdb8fd5 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:26.161292 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e8555d77-2598-41cd-a130-41786bdb8fd5 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:26.296906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e8555d77-2598-41cd-a130-41786bdb8fd5 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:26.305377 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e8555d77-2598-41cd-a130-41786bdb8fd5 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1313 microversion: 2.1 time: 0.157955 Aug 01 14:29:26.306206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 477/939] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:26 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:26.675128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-79fc2997-afcf-4be0-9d73-35f5cfc35539 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:26.675806 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-79fc2997-afcf-4be0-9d73-35f5cfc35539 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:26.682557 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-79fc2997-afcf-4be0-9d73-35f5cfc35539 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:26.683015 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-79fc2997-afcf-4be0-9d73-35f5cfc35539 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:26.683789 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-79fc2997-afcf-4be0-9d73-35f5cfc35539 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:26.684235 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-79fc2997-afcf-4be0-9d73-35f5cfc35539 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:26.821487 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-79fc2997-afcf-4be0-9d73-35f5cfc35539 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:26.829085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-79fc2997-afcf-4be0-9d73-35f5cfc35539 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1574 microversion: 2.1 time: 0.157985 Aug 01 14:29:26.829650 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 463/940] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:26 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:26.879019 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-37f75797-8c6f-494c-b38e-62721ad2272e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:26.879631 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-37f75797-8c6f-494c-b38e-62721ad2272e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:26.886119 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-37f75797-8c6f-494c-b38e-62721ad2272e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:26.886571 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-37f75797-8c6f-494c-b38e-62721ad2272e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:26.887342 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-37f75797-8c6f-494c-b38e-62721ad2272e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:26.887787 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-37f75797-8c6f-494c-b38e-62721ad2272e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:27.016754 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-37f75797-8c6f-494c-b38e-62721ad2272e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:27.024259 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-37f75797-8c6f-494c-b38e-62721ad2272e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1367 microversion: 2.1 time: 0.149073 Aug 01 14:29:27.024820 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 478/941] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:26 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:27.326252 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-87cc9226-1acc-4b21-9458-121d1ff30149 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:27.326866 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-87cc9226-1acc-4b21-9458-121d1ff30149 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:27.333608 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-87cc9226-1acc-4b21-9458-121d1ff30149 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:27.334081 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-87cc9226-1acc-4b21-9458-121d1ff30149 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:27.334856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-87cc9226-1acc-4b21-9458-121d1ff30149 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:27.335295 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-87cc9226-1acc-4b21-9458-121d1ff30149 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:27.468016 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-87cc9226-1acc-4b21-9458-121d1ff30149 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:27.476049 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-87cc9226-1acc-4b21-9458-121d1ff30149 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1313 microversion: 2.1 time: 0.153658 Aug 01 14:29:27.489779 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 464/942] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:27 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:27.611745 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-e2789089-68e5-47a0-acb5-c6fc1fc6d9f5 req-c1c3cf8f-5fa5-46fc-acce-fcfa8f15e503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a608434-236b-4efe-82ff-2abf4d225423", "name": "network-vif-plugged", "status": "completed", "tag": "330786e5-cb80-48fd-b4d6-d814d3922c64"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:29:27.623484 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-e2789089-68e5-47a0-acb5-c6fc1fc6d9f5 req-c1c3cf8f-5fa5-46fc-acce-fcfa8f15e503 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:27.623951 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-e2789089-68e5-47a0-acb5-c6fc1fc6d9f5 req-c1c3cf8f-5fa5-46fc-acce-fcfa8f15e503 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:27.637208 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-e2789089-68e5-47a0-acb5-c6fc1fc6d9f5 req-c1c3cf8f-5fa5-46fc-acce-fcfa8f15e503 service nova] Creating event network-vif-plugged:330786e5-cb80-48fd-b4d6-d814d3922c64 for instance 6a608434-236b-4efe-82ff-2abf4d225423 on hv-cinder-78729 Aug 01 14:29:27.642651 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-e2789089-68e5-47a0-acb5-c6fc1fc6d9f5 req-c1c3cf8f-5fa5-46fc-acce-fcfa8f15e503 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034766 Aug 01 14:29:27.643259 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 479/943] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:29:27.850773 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3eb15211-1406-4634-8fd9-e26ad950e1cf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:27.851391 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3eb15211-1406-4634-8fd9-e26ad950e1cf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:27.857913 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3eb15211-1406-4634-8fd9-e26ad950e1cf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:27.862433 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3eb15211-1406-4634-8fd9-e26ad950e1cf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:27.862433 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3eb15211-1406-4634-8fd9-e26ad950e1cf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:27.862433 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3eb15211-1406-4634-8fd9-e26ad950e1cf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:28.024845 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3eb15211-1406-4634-8fd9-e26ad950e1cf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:28.032990 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3eb15211-1406-4634-8fd9-e26ad950e1cf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1574 microversion: 2.1 time: 0.185974 Aug 01 14:29:28.033999 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 465/944] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:27 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:28.046123 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1c127170-f102-4ca6-afa5-5645432b7db8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:28.047619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1c127170-f102-4ca6-afa5-5645432b7db8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:28.055060 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1c127170-f102-4ca6-afa5-5645432b7db8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:28.055512 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1c127170-f102-4ca6-afa5-5645432b7db8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:28.056291 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1c127170-f102-4ca6-afa5-5645432b7db8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:28.056778 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1c127170-f102-4ca6-afa5-5645432b7db8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:28.201854 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1c127170-f102-4ca6-afa5-5645432b7db8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:28.210494 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1c127170-f102-4ca6-afa5-5645432b7db8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1367 microversion: 2.1 time: 0.168759 Aug 01 14:29:28.211081 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 480/945] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:28 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:28.499659 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-74290050-3a40-470b-abce-bda58131c802 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:28.500287 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-74290050-3a40-470b-abce-bda58131c802 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:28.506965 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-74290050-3a40-470b-abce-bda58131c802 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:28.507419 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-74290050-3a40-470b-abce-bda58131c802 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:28.508181 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-74290050-3a40-470b-abce-bda58131c802 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:28.508615 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-74290050-3a40-470b-abce-bda58131c802 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:28.638633 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-74290050-3a40-470b-abce-bda58131c802 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:28.645998 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-74290050-3a40-470b-abce-bda58131c802 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1313 microversion: 2.1 time: 0.150376 Aug 01 14:29:28.646550 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 466/946] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:28 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:29.055104 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-427cf7f1-5818-4282-8d25-cae4e2578b6e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:29.055644 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-427cf7f1-5818-4282-8d25-cae4e2578b6e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:29.062168 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-427cf7f1-5818-4282-8d25-cae4e2578b6e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:29.062612 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-427cf7f1-5818-4282-8d25-cae4e2578b6e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:29.063370 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-427cf7f1-5818-4282-8d25-cae4e2578b6e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:29.063810 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-427cf7f1-5818-4282-8d25-cae4e2578b6e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:29.195805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-427cf7f1-5818-4282-8d25-cae4e2578b6e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:29.203219 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-427cf7f1-5818-4282-8d25-cae4e2578b6e tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1574 microversion: 2.1 time: 0.152638 Aug 01 14:29:29.203773 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 481/947] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:29 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:29.230917 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3c2f405e-5f6a-40f7-964d-8d7a8d68396b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:29.231525 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3c2f405e-5f6a-40f7-964d-8d7a8d68396b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:29.237940 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3c2f405e-5f6a-40f7-964d-8d7a8d68396b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:29.239439 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3c2f405e-5f6a-40f7-964d-8d7a8d68396b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:29.240349 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3c2f405e-5f6a-40f7-964d-8d7a8d68396b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:29.240785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3c2f405e-5f6a-40f7-964d-8d7a8d68396b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:29.374121 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3c2f405e-5f6a-40f7-964d-8d7a8d68396b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:29.381888 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3c2f405e-5f6a-40f7-964d-8d7a8d68396b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1367 microversion: 2.1 time: 0.154752 Aug 01 14:29:29.382471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 467/948] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:29 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:29.659427 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-8d3511f6-a739-4542-a95c-62d04867333a req-3cc198ac-633d-4cdf-90eb-fe2e9aa4e382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5183ce-e06a-4359-93fa-e3a38b6b5cfe", "name": "network-vif-plugged", "status": "completed", "tag": "f51f7d1e-a2ab-4fe3-b803-d062f30cddc3"}, {"server_uuid": "4551bd54-cfbb-4d79-913e-6380a1e0f5f1", "name": "network-vif-plugged", "status": "completed", "tag": "2824ee5e-b738-4db9-80e9-f6a993f7e7af"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:29:29.668872 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3724b3b9-b211-4db1-9383-408c215500bd tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:29.669630 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3724b3b9-b211-4db1-9383-408c215500bd tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:29.671454 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-8d3511f6-a739-4542-a95c-62d04867333a req-3cc198ac-633d-4cdf-90eb-fe2e9aa4e382 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:29.671836 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-8d3511f6-a739-4542-a95c-62d04867333a req-3cc198ac-633d-4cdf-90eb-fe2e9aa4e382 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:29.678521 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3724b3b9-b211-4db1-9383-408c215500bd tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:29.678521 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3724b3b9-b211-4db1-9383-408c215500bd tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:29.678521 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3724b3b9-b211-4db1-9383-408c215500bd tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:29.678521 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3724b3b9-b211-4db1-9383-408c215500bd tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:29.684657 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-8d3511f6-a739-4542-a95c-62d04867333a req-3cc198ac-633d-4cdf-90eb-fe2e9aa4e382 service nova] Creating event network-vif-plugged:f51f7d1e-a2ab-4fe3-b803-d062f30cddc3 for instance 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe on hv-cinder-78729 Aug 01 14:29:29.685164 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-8d3511f6-a739-4542-a95c-62d04867333a req-3cc198ac-633d-4cdf-90eb-fe2e9aa4e382 service nova] Creating event network-vif-plugged:2824ee5e-b738-4db9-80e9-f6a993f7e7af for instance 4551bd54-cfbb-4d79-913e-6380a1e0f5f1 on hv-cinder-78729 Aug 01 14:29:29.691560 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-8d3511f6-a739-4542-a95c-62d04867333a req-3cc198ac-633d-4cdf-90eb-fe2e9aa4e382 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035832 Aug 01 14:29:29.692178 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 482/949] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:29:29.811118 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3724b3b9-b211-4db1-9383-408c215500bd tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:29.819375 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3724b3b9-b211-4db1-9383-408c215500bd tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1313 microversion: 2.1 time: 0.154789 Aug 01 14:29:29.819940 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 468/950] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:29 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:30.225906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-021177ec-72ae-438f-92b3-283117b398b3 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:30.226643 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-021177ec-72ae-438f-92b3-283117b398b3 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:30.233084 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-021177ec-72ae-438f-92b3-283117b398b3 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:30.233624 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-021177ec-72ae-438f-92b3-283117b398b3 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:30.234496 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-021177ec-72ae-438f-92b3-283117b398b3 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:30.235007 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-021177ec-72ae-438f-92b3-283117b398b3 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:30.372612 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-021177ec-72ae-438f-92b3-283117b398b3 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:30.381294 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-021177ec-72ae-438f-92b3-283117b398b3 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1574 microversion: 2.1 time: 0.160898 Aug 01 14:29:30.381918 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 483/951] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:30 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:30.402344 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e6ab136a-f17d-4358-8428-f5f8a232ce92 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:30.402944 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e6ab136a-f17d-4358-8428-f5f8a232ce92 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:30.409723 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e6ab136a-f17d-4358-8428-f5f8a232ce92 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:30.410211 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e6ab136a-f17d-4358-8428-f5f8a232ce92 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:30.411077 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e6ab136a-f17d-4358-8428-f5f8a232ce92 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:30.411519 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e6ab136a-f17d-4358-8428-f5f8a232ce92 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:30.550495 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e6ab136a-f17d-4358-8428-f5f8a232ce92 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:30.558686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e6ab136a-f17d-4358-8428-f5f8a232ce92 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1558 microversion: 2.1 time: 0.160223 Aug 01 14:29:30.559274 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 469/952] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:30 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:30.580984 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-23c2afd6-caff-48f0-bdd4-2fee9f2ae225 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:30.581476 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-23c2afd6-caff-48f0-bdd4-2fee9f2ae225 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:30.588525 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-23c2afd6-caff-48f0-bdd4-2fee9f2ae225 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:30.588974 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-23c2afd6-caff-48f0-bdd4-2fee9f2ae225 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:30.589738 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-23c2afd6-caff-48f0-bdd4-2fee9f2ae225 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:30.590324 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-23c2afd6-caff-48f0-bdd4-2fee9f2ae225 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:30.673016 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-23c2afd6-caff-48f0-bdd4-2fee9f2ae225 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096209 Aug 01 14:29:30.673625 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 484/953] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Aug 1 14:29:30 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:29:30.840266 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-68ea0a1b-80b9-4a69-a7ff-e2d9c223ab1c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:30.840993 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-68ea0a1b-80b9-4a69-a7ff-e2d9c223ab1c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:30.847043 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-68ea0a1b-80b9-4a69-a7ff-e2d9c223ab1c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:30.848115 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-68ea0a1b-80b9-4a69-a7ff-e2d9c223ab1c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:30.849095 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-68ea0a1b-80b9-4a69-a7ff-e2d9c223ab1c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:30.849594 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-68ea0a1b-80b9-4a69-a7ff-e2d9c223ab1c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:31.089878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-68ea0a1b-80b9-4a69-a7ff-e2d9c223ab1c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:31.097238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-68ea0a1b-80b9-4a69-a7ff-e2d9c223ab1c tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1313 microversion: 2.1 time: 0.260888 Aug 01 14:29:31.098757 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 470/954] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:30 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:31.403798 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-5477d15d-dc1c-471a-8cee-62e7764b8052 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:31.404475 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-5477d15d-dc1c-471a-8cee-62e7764b8052 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:31.411097 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5477d15d-dc1c-471a-8cee-62e7764b8052 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:31.411559 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5477d15d-dc1c-471a-8cee-62e7764b8052 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:31.412318 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5477d15d-dc1c-471a-8cee-62e7764b8052 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:31.412807 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5477d15d-dc1c-471a-8cee-62e7764b8052 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:31.637164 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-5477d15d-dc1c-471a-8cee-62e7764b8052 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:31.644748 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-5477d15d-dc1c-471a-8cee-62e7764b8052 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1574 microversion: 2.1 time: 0.245118 Aug 01 14:29:31.645398 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 485/955] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:31 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1574 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:31.808562 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-357a030e-2ea8-41d5-8efc-86fa0da911c6 req-83a14e75-9e30-4807-86af-5f32aaa7dc7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a608434-236b-4efe-82ff-2abf4d225423", "tag": "330786e5-cb80-48fd-b4d6-d814d3922c64"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:29:31.818851 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-357a030e-2ea8-41d5-8efc-86fa0da911c6 req-83a14e75-9e30-4807-86af-5f32aaa7dc7c service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:31.819297 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-357a030e-2ea8-41d5-8efc-86fa0da911c6 req-83a14e75-9e30-4807-86af-5f32aaa7dc7c service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:31.830149 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-357a030e-2ea8-41d5-8efc-86fa0da911c6 req-83a14e75-9e30-4807-86af-5f32aaa7dc7c service nova] Creating event network-changed:330786e5-cb80-48fd-b4d6-d814d3922c64 for instance 6a608434-236b-4efe-82ff-2abf4d225423 on hv-cinder-78729 Aug 01 14:29:31.835859 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-357a030e-2ea8-41d5-8efc-86fa0da911c6 req-83a14e75-9e30-4807-86af-5f32aaa7dc7c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030904 Aug 01 14:29:31.836457 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 471/956] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:29:32.120651 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f43398ee-a11a-4db1-b86e-f6c9042e70bc tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:32.121271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f43398ee-a11a-4db1-b86e-f6c9042e70bc tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:32.127438 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f43398ee-a11a-4db1-b86e-f6c9042e70bc tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:32.127891 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f43398ee-a11a-4db1-b86e-f6c9042e70bc tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:32.128667 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f43398ee-a11a-4db1-b86e-f6c9042e70bc tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:32.129734 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f43398ee-a11a-4db1-b86e-f6c9042e70bc tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:32.523210 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f43398ee-a11a-4db1-b86e-f6c9042e70bc tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:32.530940 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f43398ee-a11a-4db1-b86e-f6c9042e70bc tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1313 microversion: 2.1 time: 0.414355 Aug 01 14:29:32.531504 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 486/957] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:32 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:32.667432 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-eacd4403-aded-4251-86a2-7943a74a923d tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:32.668389 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-eacd4403-aded-4251-86a2-7943a74a923d tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:32.674784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-eacd4403-aded-4251-86a2-7943a74a923d tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:32.675245 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-eacd4403-aded-4251-86a2-7943a74a923d tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:32.676701 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-eacd4403-aded-4251-86a2-7943a74a923d tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:32.677866 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-eacd4403-aded-4251-86a2-7943a74a923d tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:32.825976 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-eacd4403-aded-4251-86a2-7943a74a923d tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:32.836092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-eacd4403-aded-4251-86a2-7943a74a923d tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1574 microversion: 2.1 time: 0.171435 Aug 01 14:29:32.836092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 472/958] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:32 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:33.552358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-bd83fe15-e2ac-471d-a15c-d618390a2072 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:33.552959 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-bd83fe15-e2ac-471d-a15c-d618390a2072 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:33.559498 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bd83fe15-e2ac-471d-a15c-d618390a2072 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:33.559959 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bd83fe15-e2ac-471d-a15c-d618390a2072 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:33.560733 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bd83fe15-e2ac-471d-a15c-d618390a2072 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:33.561177 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bd83fe15-e2ac-471d-a15c-d618390a2072 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:33.697017 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bd83fe15-e2ac-471d-a15c-d618390a2072 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:33.704552 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-bd83fe15-e2ac-471d-a15c-d618390a2072 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1497 microversion: 2.1 time: 0.156109 Aug 01 14:29:33.705108 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 487/959] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:33 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:29:33.857112 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5f6c2fb7-1944-41cf-9dcd-e942454a4b41 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:33.857768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5f6c2fb7-1944-41cf-9dcd-e942454a4b41 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:33.865218 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5f6c2fb7-1944-41cf-9dcd-e942454a4b41 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:33.865801 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5f6c2fb7-1944-41cf-9dcd-e942454a4b41 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:33.866614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5f6c2fb7-1944-41cf-9dcd-e942454a4b41 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:33.867052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5f6c2fb7-1944-41cf-9dcd-e942454a4b41 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:34.008827 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-5f6c2fb7-1944-41cf-9dcd-e942454a4b41 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:34.016821 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5f6c2fb7-1944-41cf-9dcd-e942454a4b41 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1561 microversion: 2.1 time: 0.163636 Aug 01 14:29:34.017391 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 473/960] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:33 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:34.653745 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-36e9ab02-eb58-494e-a263-27dcf427b89e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:34.654309 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-36e9ab02-eb58-494e-a263-27dcf427b89e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:34.660851 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-36e9ab02-eb58-494e-a263-27dcf427b89e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:34.661330 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-36e9ab02-eb58-494e-a263-27dcf427b89e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:34.662247 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-36e9ab02-eb58-494e-a263-27dcf427b89e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:34.662694 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-36e9ab02-eb58-494e-a263-27dcf427b89e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:34.687358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-36e9ab02-eb58-494e-a263-27dcf427b89e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Going to try to terminate instance {{(pid=118247) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:29:34.960534 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-36e9ab02-eb58-494e-a263-27dcf427b89e tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 204 len: 0 microversion: 2.1 time: 0.310001 Aug 01 14:29:34.961187 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 488/961] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:29:34 2022] DELETE /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:29:34.969349 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-efaa3310-6531-4af6-84d0-55e2fc0458db tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:34.969995 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-efaa3310-6531-4af6-84d0-55e2fc0458db tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:34.976824 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-efaa3310-6531-4af6-84d0-55e2fc0458db tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:34.977268 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-efaa3310-6531-4af6-84d0-55e2fc0458db tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:34.978055 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-efaa3310-6531-4af6-84d0-55e2fc0458db tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:34.993846 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-efaa3310-6531-4af6-84d0-55e2fc0458db tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:35.106229 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-efaa3310-6531-4af6-84d0-55e2fc0458db tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:35.113550 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-efaa3310-6531-4af6-84d0-55e2fc0458db tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1503 microversion: 2.1 time: 0.148026 Aug 01 14:29:35.114843 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 474/962] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:34 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:36.136906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f84514ee-5242-4b1c-924e-562a2ea36b87 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:36.137611 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f84514ee-5242-4b1c-924e-562a2ea36b87 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:36.144191 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f84514ee-5242-4b1c-924e-562a2ea36b87 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:36.144647 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f84514ee-5242-4b1c-924e-562a2ea36b87 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:36.146186 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f84514ee-5242-4b1c-924e-562a2ea36b87 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:36.146635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f84514ee-5242-4b1c-924e-562a2ea36b87 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:36.276559 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f84514ee-5242-4b1c-924e-562a2ea36b87 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:36.284085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f84514ee-5242-4b1c-924e-562a2ea36b87 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1503 microversion: 2.1 time: 0.151461 Aug 01 14:29:36.284651 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 489/963] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:36 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:37.157425 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-9fafdc68-1667-4bca-b7da-fde5fbbceb0a req-5a048f5f-ae9e-445d-bb28-69ced70a0b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5183ce-e06a-4359-93fa-e3a38b6b5cfe", "name": "network-vif-deleted", "tag": "f51f7d1e-a2ab-4fe3-b803-d062f30cddc3"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:29:37.168188 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-9fafdc68-1667-4bca-b7da-fde5fbbceb0a req-5a048f5f-ae9e-445d-bb28-69ced70a0b41 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:37.168639 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-9fafdc68-1667-4bca-b7da-fde5fbbceb0a req-5a048f5f-ae9e-445d-bb28-69ced70a0b41 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:37.172413 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=100 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:37.179698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-9fafdc68-1667-4bca-b7da-fde5fbbceb0a req-5a048f5f-ae9e-445d-bb28-69ced70a0b41 service nova] Creating event network-vif-deleted:f51f7d1e-a2ab-4fe3-b803-d062f30cddc3 for instance 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe on hv-cinder-78729 Aug 01 14:29:37.184441 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-9fafdc68-1667-4bca-b7da-fde5fbbceb0a req-5a048f5f-ae9e-445d-bb28-69ced70a0b41 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030767 Aug 01 14:29:37.185186 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 475/964] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:29:37.304516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-583ca52b-a8eb-4a41-aa3a-d5b043c8e672 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:37.305084 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-583ca52b-a8eb-4a41-aa3a-d5b043c8e672 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:37.311730 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-583ca52b-a8eb-4a41-aa3a-d5b043c8e672 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:37.312192 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-583ca52b-a8eb-4a41-aa3a-d5b043c8e672 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:37.312974 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-583ca52b-a8eb-4a41-aa3a-d5b043c8e672 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:37.313418 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-583ca52b-a8eb-4a41-aa3a-d5b043c8e672 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:37.377409 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-583ca52b-a8eb-4a41-aa3a-d5b043c8e672 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c12318332b64ca1b1b9937852215eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3ebdfb4edd4ba1ad6438a68e325219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:29:37.381746 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:37.386038 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-583ca52b-a8eb-4a41-aa3a-d5b043c8e672 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 200 len: 1298 microversion: 2.1 time: 0.085503 Aug 01 14:29:37.390408 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 490/965] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:37 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:29:38.408614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b6b716f2-54e1-4a29-b6f2-a3b6613c67f7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:29:38.409308 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b6b716f2-54e1-4a29-b6f2-a3b6613c67f7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] [instance: 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:29:38.416917 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b6b716f2-54e1-4a29-b6f2-a3b6613c67f7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:38.417364 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b6b716f2-54e1-4a29-b6f2-a3b6613c67f7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:38.418158 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b6b716f2-54e1-4a29-b6f2-a3b6613c67f7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:29:38.418588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b6b716f2-54e1-4a29-b6f2-a3b6613c67f7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:29:38.433117 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-b6b716f2-54e1-4a29-b6f2-a3b6613c67f7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] HTTP exception thrown: Instance 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe could not be found. Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b6b716f2-54e1-4a29-b6f2-a3b6613c67f7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Request method failure captured: Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe HTTP/1.1 Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-MiaUTaSKor-1C0tiohbt-sZNTSO7flb71qligGTAEiQLGIfoBAKjfMygA2h8Z-fX1ytu-twNmgujGqHaPlx4BJ4N_hmyCCGrm8CnjMACD-gejHZiLkJwgV_e3YQSjZHzxlpYdFoBAynHqX-U6qUh9GCxaCjze0Xw9vHN-1ed3y7oY Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: 1d3ebdfb4edd4ba1ad6438a68e325219 Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-VolumesActionsTest-186907533 Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:29:38.434785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:29:38.440768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d3ebdfb4edd4ba1ad6438a68e325219"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d3ebdfb4edd4ba1ad6438a68e325219"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d3ebdfb4edd4ba1ad6438a68e325219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d3ebdfb4edd4ba1ad6438a68e325219"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:29:38.440768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-VolumesActionsTest-186907533 Aug 01 14:29:38.440768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: 1d3ebdfb4edd4ba1ad6438a68e325219 Aug 01 14:29:38.440768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-VolumesActionsTest-186907533 Aug 01 14:29:38.440768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-VolumesActionsTest-186907533-project Aug 01 14:29:38.440768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:29:38.440768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:29:38.440768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: 3c12318332b64ca1b1b9937852215eaa Aug 01 14:29:38.440768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-VolumesActionsTest-186907533-project Aug 01 14:29:38.440768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:29:38.440768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe could not be found. Aug 01 14:29:38.440768 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': '1c5183ce-e06a-4359-93fa-e3a38b6b5cfe'} Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe could not be found. Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:29:38.441878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe could not be found. Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe could not be found. Aug 01 14:29:38.443697 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:29:38.445448 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b6b716f2-54e1-4a29-b6f2-a3b6613c67f7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] Returning 404 to user: Instance 1c5183ce-e06a-4359-93fa-e3a38b6b5cfe could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:29:38.445448 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b6b716f2-54e1-4a29-b6f2-a3b6613c67f7 tempest-VolumesActionsTest-186907533 tempest-VolumesActionsTest-186907533-project] 10.222.0.49 "GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe" status: 404 len: 111 microversion: 2.1 time: 0.032648 Aug 01 14:29:38.445448 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 476/966] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:29:38 2022] GET /compute/v2.1/servers/1c5183ce-e06a-4359-93fa-e3a38b6b5cfe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:30:18.625538 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-fe6f9c60-6e5f-4947-9bd7-dbb3d84841d9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:18.626193 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-fe6f9c60-6e5f-4947-9bd7-dbb3d84841d9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:18.629668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:18.634251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fe6f9c60-6e5f-4947-9bd7-dbb3d84841d9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:18.634708 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fe6f9c60-6e5f-4947-9bd7-dbb3d84841d9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:18.635504 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fe6f9c60-6e5f-4947-9bd7-dbb3d84841d9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:18.635936 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fe6f9c60-6e5f-4947-9bd7-dbb3d84841d9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:18.662629 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-fe6f9c60-6e5f-4947-9bd7-dbb3d84841d9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423/ips" status: 200 len: 151 microversion: 2.1 time: 0.041426 Aug 01 14:30:18.663208 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 491/967] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Aug 1 14:30:18 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:18.676151 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5900b75f-9800-4913-a9ec-734a2090cec6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7b472e2-73ca-4170-a4c4-9aa3d66ddf96"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:18.679469 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5900b75f-9800-4913-a9ec-734a2090cec6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:18.681907 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=52 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:18.682812 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=2 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:18.688254 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5900b75f-9800-4913-a9ec-734a2090cec6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:18.688656 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5900b75f-9800-4913-a9ec-734a2090cec6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:18.689629 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5900b75f-9800-4913-a9ec-734a2090cec6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:18.690247 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5900b75f-9800-4913-a9ec-734a2090cec6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:18.810792 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-5900b75f-9800-4913-a9ec-734a2090cec6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] HTTP exception thrown: Invalid volume: volume e7b472e2-73ca-4170-a4c4-9aa3d66ddf96 is already attached to instances: f3117aae-0e0a-491a-aa97-8aa3f63615df Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5900b75f-9800-4913-a9ec-734a2090cec6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Request method failure captured: Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: POST /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423/os-volume_attachments HTTP/1.1 Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 74 Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-L0M5WO8nDE0q1CG-Np5H3kIUpdYJfyjx92RxgagSas2PQX4zcSsYAcbMGYJoVR82J_bQyPwI-P3t2LR46Kh_WLn_u4I3f3WhblPY-X4bycK9lCMByrTu1qFbUY82UF9aEod0Q_XtMLge0BwV8zmcLvEk0eUJbXm4ubmcvI5bVAbbs Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:30:18.812810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:30:18.814278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:30:18.814278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:30:18.814278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:30:18.814278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:30:18.814278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:30:18.814278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:30:18.814278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:30:18.814278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: fbb29845a13844f89fd004b401d27b8e Aug 01 14:30:18.814278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:30:18.814278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Aug 01 14:30:18.814278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {"volumeAttachment": {"volumeId": "e7b472e2-73ca-4170-a4c4-9aa3d66ddf96"}} Aug 01 14:30:18.814278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Invalid volume: volume e7b472e2-73ca-4170-a4c4-9aa3d66ddf96 is already attached to instances: f3117aae-0e0a-491a-aa97-8aa3f63615df Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'server_id': '6a608434-236b-4efe-82ff-2abf4d225423', 'body': {'volumeAttachment': {'volumeId': 'e7b472e2-73ca-4170-a4c4-9aa3d66ddf96'}}} Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e7b472e2-73ca-4170-a4c4-9aa3d66ddf96 is already attached to instances: f3117aae-0e0a-491a-aa97-8aa3f63615df Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:30:18.818232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e7b472e2-73ca-4170-a4c4-9aa3d66ddf96 is already attached to instances: f3117aae-0e0a-491a-aa97-8aa3f63615df Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:18.819698 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:30:18.821243 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:30:18.821243 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:30:18.821243 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:30:18.821243 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e7b472e2-73ca-4170-a4c4-9aa3d66ddf96 is already attached to instances: f3117aae-0e0a-491a-aa97-8aa3f63615df Aug 01 14:30:18.821243 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:30:18.821243 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5900b75f-9800-4913-a9ec-734a2090cec6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Returning 400 to user: Invalid volume: volume e7b472e2-73ca-4170-a4c4-9aa3d66ddf96 is already attached to instances: f3117aae-0e0a-491a-aa97-8aa3f63615df {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:30:18.821243 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5900b75f-9800-4913-a9ec-734a2090cec6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "POST /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.142708 Aug 01 14:30:18.821243 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 477/968] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Aug 1 14:30:18 2022] POST /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423/os-volume_attachments => generated 174 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 01 14:30:18.824490 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f7fb76aa-cd80-4926-baa9-25799ed85662 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:18.825105 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f7fb76aa-cd80-4926-baa9-25799ed85662 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:18.831813 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f7fb76aa-cd80-4926-baa9-25799ed85662 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:18.832259 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f7fb76aa-cd80-4926-baa9-25799ed85662 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:18.834184 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f7fb76aa-cd80-4926-baa9-25799ed85662 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:18.839091 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f7fb76aa-cd80-4926-baa9-25799ed85662 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:18.881280 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f7fb76aa-cd80-4926-baa9-25799ed85662 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Going to try to terminate instance {{(pid=118247) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:30:19.151134 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f7fb76aa-cd80-4926-baa9-25799ed85662 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 204 len: 0 microversion: 2.1 time: 0.330868 Aug 01 14:30:19.152139 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 492/969] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:30:18 2022] DELETE /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:30:19.160258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0cdd8412-1513-4bd7-b0e3-718ed229c382 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:19.161055 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0cdd8412-1513-4bd7-b0e3-718ed229c382 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:19.167973 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0cdd8412-1513-4bd7-b0e3-718ed229c382 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:19.168440 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0cdd8412-1513-4bd7-b0e3-718ed229c382 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:19.169359 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0cdd8412-1513-4bd7-b0e3-718ed229c382 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:19.169863 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0cdd8412-1513-4bd7-b0e3-718ed229c382 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:19.332782 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-0cdd8412-1513-4bd7-b0e3-718ed229c382 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:19.345356 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0cdd8412-1513-4bd7-b0e3-718ed229c382 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1683 microversion: 2.1 time: 0.189193 Aug 01 14:30:19.345974 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 478/970] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:19 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1683 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:20.367965 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6b56e29c-ee43-4b7e-8002-64a6e7132101 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:20.368668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-6b56e29c-ee43-4b7e-8002-64a6e7132101 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:20.380637 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6b56e29c-ee43-4b7e-8002-64a6e7132101 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:20.381081 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6b56e29c-ee43-4b7e-8002-64a6e7132101 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:20.384400 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6b56e29c-ee43-4b7e-8002-64a6e7132101 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:20.384848 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6b56e29c-ee43-4b7e-8002-64a6e7132101 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:20.558625 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-6b56e29c-ee43-4b7e-8002-64a6e7132101 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:20.568065 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-6b56e29c-ee43-4b7e-8002-64a6e7132101 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1683 microversion: 2.1 time: 0.205101 Aug 01 14:30:20.569425 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 493/971] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:20 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1683 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:21.590555 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-fe5dbcee-50e6-47b9-a812-384eb4b28b03 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:21.591481 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-fe5dbcee-50e6-47b9-a812-384eb4b28b03 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:21.603408 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fe5dbcee-50e6-47b9-a812-384eb4b28b03 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:21.603869 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fe5dbcee-50e6-47b9-a812-384eb4b28b03 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:21.604818 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fe5dbcee-50e6-47b9-a812-384eb4b28b03 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:21.605259 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fe5dbcee-50e6-47b9-a812-384eb4b28b03 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:21.707448 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-fe5dbcee-50e6-47b9-a812-384eb4b28b03 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:21.716728 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-fe5dbcee-50e6-47b9-a812-384eb4b28b03 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1615 microversion: 2.1 time: 0.130139 Aug 01 14:30:21.717634 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 479/972] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:21 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1615 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:21.902548 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-399f7872-2f5f-4f74-9e6b-1442a0ff4a57 req-cff5475a-9382-49fa-8fce-67044662bde6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a608434-236b-4efe-82ff-2abf4d225423", "name": "network-vif-deleted", "tag": "330786e5-cb80-48fd-b4d6-d814d3922c64"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:21.922693 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-399f7872-2f5f-4f74-9e6b-1442a0ff4a57 req-cff5475a-9382-49fa-8fce-67044662bde6 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:21.923656 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-399f7872-2f5f-4f74-9e6b-1442a0ff4a57 req-cff5475a-9382-49fa-8fce-67044662bde6 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:21.941711 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-399f7872-2f5f-4f74-9e6b-1442a0ff4a57 req-cff5475a-9382-49fa-8fce-67044662bde6 service nova] Creating event network-vif-deleted:330786e5-cb80-48fd-b4d6-d814d3922c64 for instance 6a608434-236b-4efe-82ff-2abf4d225423 on hv-cinder-78729 Aug 01 14:30:21.953455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-399f7872-2f5f-4f74-9e6b-1442a0ff4a57 req-cff5475a-9382-49fa-8fce-67044662bde6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054569 Aug 01 14:30:21.954728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 494/973] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:22.741047 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-cb9763b2-4b73-4419-afed-8d9acec052c5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:22.747814 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-cb9763b2-4b73-4419-afed-8d9acec052c5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:22.775175 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cb9763b2-4b73-4419-afed-8d9acec052c5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:22.775960 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cb9763b2-4b73-4419-afed-8d9acec052c5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:22.787788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cb9763b2-4b73-4419-afed-8d9acec052c5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:22.790408 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cb9763b2-4b73-4419-afed-8d9acec052c5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:22.834147 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cb9763b2-4b73-4419-afed-8d9acec052c5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:22.834517 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-cb9763b2-4b73-4419-afed-8d9acec052c5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:22.834978 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-cb9763b2-4b73-4419-afed-8d9acec052c5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lazy-loading 'fault' on Instance uuid 6a608434-236b-4efe-82ff-2abf4d225423 {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:30:22.888641 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-cb9763b2-4b73-4419-afed-8d9acec052c5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:22.899885 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-cb9763b2-4b73-4419-afed-8d9acec052c5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 200 len: 1331 microversion: 2.1 time: 0.165519 Aug 01 14:30:22.902008 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 480/974] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:22 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 1331 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:23.923561 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f3f5c229-d57c-49e3-bf5d-cf58170deef4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:23.924909 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f3f5c229-d57c-49e3-bf5d-cf58170deef4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:23.934178 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f3f5c229-d57c-49e3-bf5d-cf58170deef4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:23.935001 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f3f5c229-d57c-49e3-bf5d-cf58170deef4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:23.936020 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f3f5c229-d57c-49e3-bf5d-cf58170deef4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:23.936708 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f3f5c229-d57c-49e3-bf5d-cf58170deef4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:23.952151 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-f3f5c229-d57c-49e3-bf5d-cf58170deef4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] HTTP exception thrown: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f3f5c229-d57c-49e3-bf5d-cf58170deef4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Request method failure captured: Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 HTTP/1.1 Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-L0M5WO8nDE0q1CG-Np5H3kIUpdYJfyjx92RxgagSas2PQX4zcSsYAcbMGYJoVR82J_bQyPwI-P3t2LR46Kh_WLn_u4I3f3WhblPY-X4bycK9lCMByrTu1qFbUY82UF9aEod0Q_XtMLge0BwV8zmcLvEk0eUJbXm4ubmcvI5bVAbbs Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:30:23.954206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:30:23.955598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:30:23.955598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:30:23.955598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:30:23.955598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:30:23.955598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:30:23.955598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:30:23.955598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:30:23.955598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: fbb29845a13844f89fd004b401d27b8e Aug 01 14:30:23.955598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:30:23.955598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:30:23.955598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. Aug 01 14:30:23.955598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '6a608434-236b-4efe-82ff-2abf4d225423'} Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:30:23.956358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. Aug 01 14:30:23.957641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:30:23.961404 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f3f5c229-d57c-49e3-bf5d-cf58170deef4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Returning 404 to user: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:30:23.962578 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f3f5c229-d57c-49e3-bf5d-cf58170deef4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 404 len: 111 microversion: 2.1 time: 0.043197 Aug 01 14:30:23.963370 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 495/975] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:23 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:30:23.972422 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-05966d12-54b5-4dc6-9866-a40443cee2fa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '.version_select at 0x7fb24eff41f0>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:24.078928 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-05966d12-54b5-4dc6-9866-a40443cee2fa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-558362281" status: 202 len: 0 microversion: 2.1 time: 0.110876 Aug 01 14:30:24.079435 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 481/976] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Aug 1 14:30:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-558362281 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:30:25.206381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d588a9f2-9d21-4f00-846a-35c1549699d6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:25.207022 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d588a9f2-9d21-4f00-846a-35c1549699d6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:25.214638 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d588a9f2-9d21-4f00-846a-35c1549699d6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:25.217178 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d588a9f2-9d21-4f00-846a-35c1549699d6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:25.218279 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d588a9f2-9d21-4f00-846a-35c1549699d6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:25.218726 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d588a9f2-9d21-4f00-846a-35c1549699d6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:25.321780 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-d588a9f2-9d21-4f00-846a-35c1549699d6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lazy-loading 'services' on Instance uuid f3117aae-0e0a-491a-aa97-8aa3f63615df {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:30:25.504219 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d588a9f2-9d21-4f00-846a-35c1549699d6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df/os-volume_attachments/e7b472e2-73ca-4170-a4c4-9aa3d66ddf96" status: 202 len: 0 microversion: 2.1 time: 0.300578 Aug 01 14:30:25.505527 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 496/977] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Aug 1 14:30:25 2022] DELETE /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df/os-volume_attachments/e7b472e2-73ca-4170-a4c4-9aa3d66ddf96 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:30:25.535349 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-eb7bd835-98b0-419d-a77b-d63104e2d019 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:25.544790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-eb7bd835-98b0-419d-a77b-d63104e2d019 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:25.563487 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-eb7bd835-98b0-419d-a77b-d63104e2d019 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:25.564321 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-eb7bd835-98b0-419d-a77b-d63104e2d019 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:25.565144 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-eb7bd835-98b0-419d-a77b-d63104e2d019 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:25.565580 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-eb7bd835-98b0-419d-a77b-d63104e2d019 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:25.615073 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-eb7bd835-98b0-419d-a77b-d63104e2d019 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101867 Aug 01 14:30:25.618425 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 482/978] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:30:25 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:26.635357 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c62c4d08-3b6a-40cd-bd21-ac71df1643d8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:26.638772 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c62c4d08-3b6a-40cd-bd21-ac71df1643d8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:26.652487 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c62c4d08-3b6a-40cd-bd21-ac71df1643d8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:26.700472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c62c4d08-3b6a-40cd-bd21-ac71df1643d8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:26.700472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c62c4d08-3b6a-40cd-bd21-ac71df1643d8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:26.700472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c62c4d08-3b6a-40cd-bd21-ac71df1643d8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:26.700472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c62c4d08-3b6a-40cd-bd21-ac71df1643d8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068707 Aug 01 14:30:26.701480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 497/979] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:30:26 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:27.706176 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-67ffb6ec-fe00-4425-80f7-92bbbb2531b8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:27.711584 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-67ffb6ec-fe00-4425-80f7-92bbbb2531b8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:27.718221 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-67ffb6ec-fe00-4425-80f7-92bbbb2531b8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:27.718887 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-67ffb6ec-fe00-4425-80f7-92bbbb2531b8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:27.719835 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-67ffb6ec-fe00-4425-80f7-92bbbb2531b8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:27.720269 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-67ffb6ec-fe00-4425-80f7-92bbbb2531b8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:27.753147 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-67ffb6ec-fe00-4425-80f7-92bbbb2531b8 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051033 Aug 01 14:30:27.753715 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 483/980] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:30:27 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:30:27.845547 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-cf56565f-f767-4816-b7ca-a256284ec1a4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:27.846138 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-cf56565f-f767-4816-b7ca-a256284ec1a4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:27.853704 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cf56565f-f767-4816-b7ca-a256284ec1a4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:27.854193 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cf56565f-f767-4816-b7ca-a256284ec1a4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:27.854972 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cf56565f-f767-4816-b7ca-a256284ec1a4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:27.855594 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cf56565f-f767-4816-b7ca-a256284ec1a4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:28.051910 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-cf56565f-f767-4816-b7ca-a256284ec1a4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Going to try to terminate instance {{(pid=118247) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:30:28.401517 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-cf56565f-f767-4816-b7ca-a256284ec1a4 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 204 len: 0 microversion: 2.1 time: 0.559380 Aug 01 14:30:28.402490 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 498/981] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:30:27 2022] DELETE /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:30:28.410525 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7c863b42-131c-4d74-96ff-6aa45717d2cf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:28.411137 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7c863b42-131c-4d74-96ff-6aa45717d2cf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:28.417321 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7c863b42-131c-4d74-96ff-6aa45717d2cf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:28.417791 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7c863b42-131c-4d74-96ff-6aa45717d2cf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:28.418772 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7c863b42-131c-4d74-96ff-6aa45717d2cf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:28.419207 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7c863b42-131c-4d74-96ff-6aa45717d2cf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:28.785802 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7c863b42-131c-4d74-96ff-6aa45717d2cf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:28.797533 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7c863b42-131c-4d74-96ff-6aa45717d2cf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 200 len: 1682 microversion: 2.1 time: 0.390680 Aug 01 14:30:28.798147 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 484/982] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:28 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 1682 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:29.825414 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f2e995ef-bde4-4ef1-b4dd-5707f45202c6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:29.826095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f2e995ef-bde4-4ef1-b4dd-5707f45202c6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:29.833255 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f2e995ef-bde4-4ef1-b4dd-5707f45202c6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:29.833881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f2e995ef-bde4-4ef1-b4dd-5707f45202c6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:29.834844 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f2e995ef-bde4-4ef1-b4dd-5707f45202c6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:29.835446 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f2e995ef-bde4-4ef1-b4dd-5707f45202c6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:30.058329 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f2e995ef-bde4-4ef1-b4dd-5707f45202c6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:30.062923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f2e995ef-bde4-4ef1-b4dd-5707f45202c6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 200 len: 1682 microversion: 2.1 time: 0.242102 Aug 01 14:30:30.063474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 499/983] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:29 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:30.675419 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-168d7891-550b-4590-b1dc-eb33250ba931 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Action: 'create', calling method: .version_select at 0x7fb24ef05280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-663382889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhbgz85TJcdByNAuLXqUvA/ZQOaxh7I5iwIkNfXsqdHDfPd4/4tjAhW5ZjxCp6EOGP0nUk1YrwL5wd2yhFyMeGmu8FyCuQPfyIAci0wN+/DgfJJDqR3IxylwaISNIKqsQ=="}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:30.700863 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-168d7891-550b-4590-b1dc-eb33250ba931 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Getting quotas for project 937e807649094f70844259eafaef26b1. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:30:30.707417 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-168d7891-550b-4590-b1dc-eb33250ba931 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Getting quotas for user 0f18192b9dd241909b1957a7d43858c3 and project 937e807649094f70844259eafaef26b1. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:30:30.785924 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-168d7891-550b-4590-b1dc-eb33250ba931 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.114525 Aug 01 14:30:30.786547 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 485/984] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Aug 1 14:30:30 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:30.846159 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-9895ab2b-065c-418d-88c4-ac8e4f30bf2f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-66405099", "imageRef": "352441b4-a2d1-4c74-8b32-74ddcf6de4ba", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-663382889", "networks": [{"uuid": "a872f1b8-5b38-424b-a39a-8624b7efed09"}]}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:30.912168 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.network.neutron [None req-9895ab2b-065c-418d-88c4-ac8e4f30bf2f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] validate_networks() for [('a872f1b8-5b38-424b-a39a-8624b7efed09', None, None, None, None, None)] {{(pid=118247) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:30:31.085848 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-035e8a5c-1534-4e95-bd29-aefca0bfe985 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:31.090584 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-035e8a5c-1534-4e95-bd29-aefca0bfe985 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:31.100558 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-035e8a5c-1534-4e95-bd29-aefca0bfe985 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:31.101161 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-035e8a5c-1534-4e95-bd29-aefca0bfe985 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:31.102235 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-035e8a5c-1534-4e95-bd29-aefca0bfe985 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:31.104913 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-035e8a5c-1534-4e95-bd29-aefca0bfe985 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:31.218982 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-035e8a5c-1534-4e95-bd29-aefca0bfe985 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:31.229256 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-035e8a5c-1534-4e95-bd29-aefca0bfe985 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 200 len: 1614 microversion: 2.1 time: 0.149641 Aug 01 14:30:31.232980 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 486/985] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:31 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 1614 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:31.362292 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-9895ab2b-065c-418d-88c4-ac8e4f30bf2f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Flavor limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:30:31.362715 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-9895ab2b-065c-418d-88c4-ac8e4f30bf2f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Image limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:30:31.363194 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-9895ab2b-065c-418d-88c4-ac8e4f30bf2f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Flavor pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:30:31.363865 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-9895ab2b-065c-418d-88c4-ac8e4f30bf2f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Image pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:30:31.364461 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-9895ab2b-065c-418d-88c4-ac8e4f30bf2f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:30:31.380564 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9895ab2b-065c-418d-88c4-ac8e4f30bf2f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:31.381234 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9895ab2b-065c-418d-88c4-ac8e4f30bf2f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:31.382317 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9895ab2b-065c-418d-88c4-ac8e4f30bf2f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:31.382761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9895ab2b-065c-418d-88c4-ac8e4f30bf2f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:31.404188 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-9895ab2b-065c-418d-88c4-ac8e4f30bf2f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Getting quotas for project 937e807649094f70844259eafaef26b1. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:30:31.410737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-9895ab2b-065c-418d-88c4-ac8e4f30bf2f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Getting quotas for user 0f18192b9dd241909b1957a7d43858c3 and project 937e807649094f70844259eafaef26b1. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:30:31.428124 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-811cafdd-7e0c-4d85-a008-2b6d8e253a7b req-d256afa4-8e51-4c8f-ac38-57848309616c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3117aae-0e0a-491a-aa97-8aa3f63615df", "name": "network-vif-deleted", "tag": "0ab1f378-12d0-4be5-9948-e3cb682adb00"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:31.431384 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-9895ab2b-065c-418d-88c4-ac8e4f30bf2f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Going to run 1 instances... {{(pid=118247) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:30:31.433614 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-9895ab2b-065c-418d-88c4-ac8e4f30bf2f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='352441b4-a2d1-4c74-8b32-74ddcf6de4ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118247) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:30:31.447820 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-811cafdd-7e0c-4d85-a008-2b6d8e253a7b req-d256afa4-8e51-4c8f-ac38-57848309616c service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:31.450042 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-811cafdd-7e0c-4d85-a008-2b6d8e253a7b req-d256afa4-8e51-4c8f-ac38-57848309616c service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:31.466383 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-811cafdd-7e0c-4d85-a008-2b6d8e253a7b req-d256afa4-8e51-4c8f-ac38-57848309616c service nova] Creating event network-vif-deleted:0ab1f378-12d0-4be5-9948-e3cb682adb00 for instance f3117aae-0e0a-491a-aa97-8aa3f63615df on hv-cinder-78729 Aug 01 14:30:31.473699 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-811cafdd-7e0c-4d85-a008-2b6d8e253a7b req-d256afa4-8e51-4c8f-ac38-57848309616c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049711 Aug 01 14:30:31.479191 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 487/986] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:30:31.564095 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-9895ab2b-065c-418d-88c4-ac8e4f30bf2f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723313 Aug 01 14:30:31.577386 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-bd91bcb9-aa30-473b-80a2-584caceb1615 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:31.578367 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-bd91bcb9-aa30-473b-80a2-584caceb1615 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:31.582619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 500/987] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:30:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:30:31.659052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-bd91bcb9-aa30-473b-80a2-584caceb1615 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:31.668889 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-bd91bcb9-aa30-473b-80a2-584caceb1615 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1256 microversion: 2.1 time: 0.095720 Aug 01 14:30:31.682757 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 488/988] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:31 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1256 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:32.257006 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a2dd9d2e-468c-44ba-ac2e-28ec9d1c0139 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:32.259841 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a2dd9d2e-468c-44ba-ac2e-28ec9d1c0139 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:32.268226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a2dd9d2e-468c-44ba-ac2e-28ec9d1c0139 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:32.270195 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a2dd9d2e-468c-44ba-ac2e-28ec9d1c0139 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:32.270195 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a2dd9d2e-468c-44ba-ac2e-28ec9d1c0139 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:32.270195 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a2dd9d2e-468c-44ba-ac2e-28ec9d1c0139 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:32.308602 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a2dd9d2e-468c-44ba-ac2e-28ec9d1c0139 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:32.309065 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a2dd9d2e-468c-44ba-ac2e-28ec9d1c0139 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:32.309586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-a2dd9d2e-468c-44ba-ac2e-28ec9d1c0139 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lazy-loading 'fault' on Instance uuid f3117aae-0e0a-491a-aa97-8aa3f63615df {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:30:32.367439 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a2dd9d2e-468c-44ba-ac2e-28ec9d1c0139 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:32.378714 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a2dd9d2e-468c-44ba-ac2e-28ec9d1c0139 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 200 len: 1332 microversion: 2.1 time: 0.128303 Aug 01 14:30:32.380133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 501/989] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:32 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 1332 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:32.693513 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c4acdca2-214e-4c89-988e-2415a6739b0b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:32.694181 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c4acdca2-214e-4c89-988e-2415a6739b0b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:32.786258 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c4acdca2-214e-4c89-988e-2415a6739b0b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:32.795455 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c4acdca2-214e-4c89-988e-2415a6739b0b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1256 microversion: 2.1 time: 0.106930 Aug 01 14:30:32.796953 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 489/990] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:32 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1256 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:33.401691 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1a7ffc65-9a19-40e5-a0db-6df7a2f6b58d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:33.402352 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1a7ffc65-9a19-40e5-a0db-6df7a2f6b58d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:33.411795 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1a7ffc65-9a19-40e5-a0db-6df7a2f6b58d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:33.412497 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1a7ffc65-9a19-40e5-a0db-6df7a2f6b58d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:33.413600 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1a7ffc65-9a19-40e5-a0db-6df7a2f6b58d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:33.414599 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1a7ffc65-9a19-40e5-a0db-6df7a2f6b58d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:33.428961 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-1a7ffc65-9a19-40e5-a0db-6df7a2f6b58d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] HTTP exception thrown: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1a7ffc65-9a19-40e5-a0db-6df7a2f6b58d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Request method failure captured: Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df HTTP/1.1 Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-L0M5WO8nDE0q1CG-Np5H3kIUpdYJfyjx92RxgagSas2PQX4zcSsYAcbMGYJoVR82J_bQyPwI-P3t2LR46Kh_WLn_u4I3f3WhblPY-X4bycK9lCMByrTu1qFbUY82UF9aEod0Q_XtMLge0BwV8zmcLvEk0eUJbXm4ubmcvI5bVAbbs Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:30:33.431681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:30:33.433069 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:30:33.433069 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:30:33.433069 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:30:33.433069 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:30:33.433069 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:30:33.433069 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:30:33.433069 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:30:33.433069 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: fbb29845a13844f89fd004b401d27b8e Aug 01 14:30:33.433069 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:30:33.433069 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:30:33.433069 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. Aug 01 14:30:33.433069 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': 'f3117aae-0e0a-491a-aa97-8aa3f63615df'} Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:30:33.433979 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. Aug 01 14:30:33.435381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:30:33.437109 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1a7ffc65-9a19-40e5-a0db-6df7a2f6b58d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Returning 404 to user: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:30:33.437109 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1a7ffc65-9a19-40e5-a0db-6df7a2f6b58d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 404 len: 111 microversion: 2.1 time: 0.037697 Aug 01 14:30:33.437109 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 502/991] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:33 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:30:33.447865 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-96a7c23e-db2d-425d-869e-70fd810a3dfd tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '.version_select at 0x7fb24efb5e50>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:33.549379 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-96a7c23e-db2d-425d-869e-70fd810a3dfd tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1714862031" status: 202 len: 0 microversion: 2.1 time: 0.108463 Aug 01 14:30:33.550090 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 490/992] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Aug 1 14:30:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1714862031 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:30:33.818928 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e4b02ed1-fd3b-4fee-a410-6a9a7c5ae23e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:33.819545 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e4b02ed1-fd3b-4fee-a410-6a9a7c5ae23e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:33.839792 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e4b02ed1-fd3b-4fee-a410-6a9a7c5ae23e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:33.840666 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e4b02ed1-fd3b-4fee-a410-6a9a7c5ae23e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:33.841862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e4b02ed1-fd3b-4fee-a410-6a9a7c5ae23e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:33.842704 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e4b02ed1-fd3b-4fee-a410-6a9a7c5ae23e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:33.934587 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e4b02ed1-fd3b-4fee-a410-6a9a7c5ae23e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:33.943588 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e4b02ed1-fd3b-4fee-a410-6a9a7c5ae23e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1308 microversion: 2.1 time: 0.128396 Aug 01 14:30:33.944516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 503/993] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:33 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1308 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:34.018726 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-75d12f9e-9a28-43e6-9e42-72d6f65f7085 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:34.020025 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-75d12f9e-9a28-43e6-9e42-72d6f65f7085 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:34.033911 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-75d12f9e-9a28-43e6-9e42-72d6f65f7085 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:34.034515 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-75d12f9e-9a28-43e6-9e42-72d6f65f7085 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:34.035460 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-75d12f9e-9a28-43e6-9e42-72d6f65f7085 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:34.036166 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-75d12f9e-9a28-43e6-9e42-72d6f65f7085 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:34.067167 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-75d12f9e-9a28-43e6-9e42-72d6f65f7085 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Going to try to terminate instance {{(pid=118246) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:30:34.439620 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-75d12f9e-9a28-43e6-9e42-72d6f65f7085 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 204 len: 0 microversion: 2.1 time: 0.426597 Aug 01 14:30:34.451279 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1e159f1e-63ac-44a7-a518-f15295675861 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:34.451903 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1e159f1e-63ac-44a7-a518-f15295675861 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:34.452464 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 491/994] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:30:34 2022] DELETE /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:30:34.460276 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1e159f1e-63ac-44a7-a518-f15295675861 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:34.461474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1e159f1e-63ac-44a7-a518-f15295675861 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:34.462482 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1e159f1e-63ac-44a7-a518-f15295675861 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:34.463140 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1e159f1e-63ac-44a7-a518-f15295675861 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:34.474490 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5dbd3973-ad67-4338-a15c-35a2f6557c82 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Action: 'create', calling method: .version_select at 0x7fb2540935e0>, body: {"keypair": {"name": "tempest-keypair-1089458345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZqK0CZH3+LhHG2At0t3tSO3TsELywU91drFDQFpWFvMVDZKRNe6X3LPscj/bb6oVr2JDXW0dvfqoekTKcZi2NzEDHzNk8KUU7RGeLrOS7oXmTNhIVDqbU0G1T/mHKm6Q=="}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:34.494322 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-5dbd3973-ad67-4338-a15c-35a2f6557c82 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Getting quotas for project c6df4baf0a1242f2b73fe99071682355. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:30:34.498330 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-5dbd3973-ad67-4338-a15c-35a2f6557c82 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Getting quotas for user fbb29845a13844f89fd004b401d27b8e and project c6df4baf0a1242f2b73fe99071682355. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:30:34.590827 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5dbd3973-ad67-4338-a15c-35a2f6557c82 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121033 Aug 01 14:30:34.592974 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 492/995] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Aug 1 14:30:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:30:34.656169 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1e159f1e-63ac-44a7-a518-f15295675861 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:34.671821 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1e159f1e-63ac-44a7-a518-f15295675861 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1579 microversion: 2.1 time: 0.219584 Aug 01 14:30:34.671821 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 504/996] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:34 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1579 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:34.964668 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7bf38018-e67b-444c-96c1-2b96d22fef7a tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:34.965477 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7bf38018-e67b-444c-96c1-2b96d22fef7a tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:34.977164 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7bf38018-e67b-444c-96c1-2b96d22fef7a tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:34.982544 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7bf38018-e67b-444c-96c1-2b96d22fef7a tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:34.982544 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7bf38018-e67b-444c-96c1-2b96d22fef7a tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:34.982544 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7bf38018-e67b-444c-96c1-2b96d22fef7a tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:35.163973 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7bf38018-e67b-444c-96c1-2b96d22fef7a tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:35.176056 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7bf38018-e67b-444c-96c1-2b96d22fef7a tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1368 microversion: 2.1 time: 0.215384 Aug 01 14:30:35.177440 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 493/997] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:34 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:35.687615 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-2e2401d8-099d-4d19-84d1-6604fb7a24ae tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:35.689662 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-2e2401d8-099d-4d19-84d1-6604fb7a24ae tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:35.698732 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2e2401d8-099d-4d19-84d1-6604fb7a24ae tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:35.699187 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2e2401d8-099d-4d19-84d1-6604fb7a24ae tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:35.699976 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2e2401d8-099d-4d19-84d1-6604fb7a24ae tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:35.700407 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2e2401d8-099d-4d19-84d1-6604fb7a24ae tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:35.874822 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2e2401d8-099d-4d19-84d1-6604fb7a24ae tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:35.885217 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-2e2401d8-099d-4d19-84d1-6604fb7a24ae tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1579 microversion: 2.1 time: 0.201274 Aug 01 14:30:35.886233 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 505/998] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:35 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1579 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:36.204423 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d777f2d4-26ee-4d5c-9f74-ad79eb4c0427 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:36.205028 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d777f2d4-26ee-4d5c-9f74-ad79eb4c0427 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:36.214380 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d777f2d4-26ee-4d5c-9f74-ad79eb4c0427 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:36.214828 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d777f2d4-26ee-4d5c-9f74-ad79eb4c0427 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:36.216836 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d777f2d4-26ee-4d5c-9f74-ad79eb4c0427 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:36.217334 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d777f2d4-26ee-4d5c-9f74-ad79eb4c0427 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:36.400719 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d777f2d4-26ee-4d5c-9f74-ad79eb4c0427 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:36.422135 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d777f2d4-26ee-4d5c-9f74-ad79eb4c0427 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1356 microversion: 2.1 time: 0.216955 Aug 01 14:30:36.422135 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 494/999] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:36 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1356 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:36.910622 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e0876b6f-b628-405f-bcce-a2f33c8aaa74 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:36.913637 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e0876b6f-b628-405f-bcce-a2f33c8aaa74 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:36.924307 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e0876b6f-b628-405f-bcce-a2f33c8aaa74 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:36.925138 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e0876b6f-b628-405f-bcce-a2f33c8aaa74 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:36.926461 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e0876b6f-b628-405f-bcce-a2f33c8aaa74 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:36.927184 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e0876b6f-b628-405f-bcce-a2f33c8aaa74 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:36.938149 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:37.180128 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e0876b6f-b628-405f-bcce-a2f33c8aaa74 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:37.193831 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e0876b6f-b628-405f-bcce-a2f33c8aaa74 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1579 microversion: 2.1 time: 0.289845 Aug 01 14:30:37.194255 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 506/1000] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:36 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1579 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:37.444785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-9f8d38b0-c40d-4551-8a78-be8fc3d4e186 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:37.446887 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-9f8d38b0-c40d-4551-8a78-be8fc3d4e186 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:37.460804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9f8d38b0-c40d-4551-8a78-be8fc3d4e186 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:37.466278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9f8d38b0-c40d-4551-8a78-be8fc3d4e186 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:37.466278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9f8d38b0-c40d-4551-8a78-be8fc3d4e186 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:37.466278 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9f8d38b0-c40d-4551-8a78-be8fc3d4e186 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:37.584601 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-9b425cd1-67f2-4525-8648-385577009f29 req-9cfe1770-d528-4bcb-9a35-a10c6ddded6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f818132-d74c-4e1d-80d2-26fbc8d68325", "tag": "2d661070-4d21-4715-be5d-845fc083bf67"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:37.618716 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-9b425cd1-67f2-4525-8648-385577009f29 req-9cfe1770-d528-4bcb-9a35-a10c6ddded6a service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:37.621667 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-9b425cd1-67f2-4525-8648-385577009f29 req-9cfe1770-d528-4bcb-9a35-a10c6ddded6a service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:37.663690 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-9b425cd1-67f2-4525-8648-385577009f29 req-9cfe1770-d528-4bcb-9a35-a10c6ddded6a service nova] Creating event network-changed:2d661070-4d21-4715-be5d-845fc083bf67 for instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 on hv-cinder-78729 Aug 01 14:30:37.678127 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-9b425cd1-67f2-4525-8648-385577009f29 req-9cfe1770-d528-4bcb-9a35-a10c6ddded6a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096745 Aug 01 14:30:37.678127 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 507/1001] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:37.743695 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-9f8d38b0-c40d-4551-8a78-be8fc3d4e186 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:37.757447 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-9f8d38b0-c40d-4551-8a78-be8fc3d4e186 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1356 microversion: 2.1 time: 0.321793 Aug 01 14:30:37.778908 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 495/1002] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:37 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1356 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:38.222334 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-8db38aed-566a-48b6-91cd-dd246b916e50 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:38.223775 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-8db38aed-566a-48b6-91cd-dd246b916e50 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:38.243567 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8db38aed-566a-48b6-91cd-dd246b916e50 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:38.246527 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8db38aed-566a-48b6-91cd-dd246b916e50 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:38.248135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8db38aed-566a-48b6-91cd-dd246b916e50 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:38.248881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8db38aed-566a-48b6-91cd-dd246b916e50 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:38.363072 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-8db38aed-566a-48b6-91cd-dd246b916e50 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:38.374483 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-8db38aed-566a-48b6-91cd-dd246b916e50 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1511 microversion: 2.1 time: 0.160960 Aug 01 14:30:38.375284 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 508/1003] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:38 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:38.788599 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8f084b81-3205-4acf-bec9-98e685628867 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:38.789358 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8f084b81-3205-4acf-bec9-98e685628867 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:38.812708 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8f084b81-3205-4acf-bec9-98e685628867 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:38.813335 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8f084b81-3205-4acf-bec9-98e685628867 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:38.816791 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8f084b81-3205-4acf-bec9-98e685628867 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:38.818032 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8f084b81-3205-4acf-bec9-98e685628867 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:39.188567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8f084b81-3205-4acf-bec9-98e685628867 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:39.231308 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8f084b81-3205-4acf-bec9-98e685628867 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1356 microversion: 2.1 time: 0.454661 Aug 01 14:30:39.234798 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 496/1004] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:38 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1356 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:39.306105 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-2235b152-ca26-4e89-acfa-70ac07bfaa1b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-608232191", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34cc3867-be64-4b6c-a790-8e0e66fb7fc3"}], "security_groups": [{"name": "tempest-securitygroup--1892530849"}], "key_name": "tempest-keypair-1089458345", "user_data": "}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:39.404343 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e17af685-886f-408f-a5a4-b4e9754495d4 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:39.404966 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e17af685-886f-408f-a5a4-b4e9754495d4 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:39.417300 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e17af685-886f-408f-a5a4-b4e9754495d4 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:39.417798 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e17af685-886f-408f-a5a4-b4e9754495d4 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:39.418573 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e17af685-886f-408f-a5a4-b4e9754495d4 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:39.419015 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e17af685-886f-408f-a5a4-b4e9754495d4 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:39.504043 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.network.neutron [None req-2235b152-ca26-4e89-acfa-70ac07bfaa1b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] validate_networks() for [('34cc3867-be64-4b6c-a790-8e0e66fb7fc3', None, None, None, None, None)] {{(pid=118247) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:30:39.747785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e17af685-886f-408f-a5a4-b4e9754495d4 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:39.765044 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e17af685-886f-408f-a5a4-b4e9754495d4 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1225 microversion: 2.1 time: 0.372226 Aug 01 14:30:39.765649 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 497/1005] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:39 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1225 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:39.811224 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-8a3f2bb7-c4ca-47cf-b4ea-0feaac6c4ef6 req-fb6b04c1-1547-4b24-a420-a13c8b2aac71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a377af0-0542-410e-93c3-e8c076f16ce6", "name": "network-vif-deleted", "tag": "416f1933-aa1d-4746-9f1f-44a8878036a3"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:39.844793 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-8a3f2bb7-c4ca-47cf-b4ea-0feaac6c4ef6 req-fb6b04c1-1547-4b24-a420-a13c8b2aac71 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:39.846826 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-8a3f2bb7-c4ca-47cf-b4ea-0feaac6c4ef6 req-fb6b04c1-1547-4b24-a420-a13c8b2aac71 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:39.854504 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:39.874597 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-8a3f2bb7-c4ca-47cf-b4ea-0feaac6c4ef6 req-fb6b04c1-1547-4b24-a420-a13c8b2aac71 service nova] Creating event network-vif-deleted:416f1933-aa1d-4746-9f1f-44a8878036a3 for instance 6a377af0-0542-410e-93c3-e8c076f16ce6 on hv-cinder-78729 Aug 01 14:30:39.880682 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-8a3f2bb7-c4ca-47cf-b4ea-0feaac6c4ef6 req-fb6b04c1-1547-4b24-a420-a13c8b2aac71 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079944 Aug 01 14:30:39.881992 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 498/1006] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:30:40.263133 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-75e41d00-82a4-42b4-982d-0a0caac2450e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:40.263882 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-75e41d00-82a4-42b4-982d-0a0caac2450e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:40.292537 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-75e41d00-82a4-42b4-982d-0a0caac2450e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:40.293067 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-75e41d00-82a4-42b4-982d-0a0caac2450e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:40.297297 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-75e41d00-82a4-42b4-982d-0a0caac2450e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:40.299171 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-75e41d00-82a4-42b4-982d-0a0caac2450e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:40.540559 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-2235b152-ca26-4e89-acfa-70ac07bfaa1b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Flavor limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:30:40.546626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-2235b152-ca26-4e89-acfa-70ac07bfaa1b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Image limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:30:40.549361 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-2235b152-ca26-4e89-acfa-70ac07bfaa1b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Flavor pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:30:40.550770 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-2235b152-ca26-4e89-acfa-70ac07bfaa1b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Image pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:30:40.555499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-2235b152-ca26-4e89-acfa-70ac07bfaa1b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:30:40.586574 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-75e41d00-82a4-42b4-982d-0a0caac2450e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:40.590634 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2235b152-ca26-4e89-acfa-70ac07bfaa1b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:40.591389 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2235b152-ca26-4e89-acfa-70ac07bfaa1b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:40.592572 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2235b152-ca26-4e89-acfa-70ac07bfaa1b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:40.593707 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2235b152-ca26-4e89-acfa-70ac07bfaa1b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:40.597281 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-75e41d00-82a4-42b4-982d-0a0caac2450e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1356 microversion: 2.1 time: 0.345857 Aug 01 14:30:40.615610 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 499/1007] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:40 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1356 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:40.622638 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-2235b152-ca26-4e89-acfa-70ac07bfaa1b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Getting quotas for project c6df4baf0a1242f2b73fe99071682355. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:30:40.627087 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-2235b152-ca26-4e89-acfa-70ac07bfaa1b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Getting quotas for user fbb29845a13844f89fd004b401d27b8e and project c6df4baf0a1242f2b73fe99071682355. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:30:40.639330 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-2235b152-ca26-4e89-acfa-70ac07bfaa1b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Going to run 1 instances... {{(pid=118247) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:30:40.641899 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-2235b152-ca26-4e89-acfa-70ac07bfaa1b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118247) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:30:40.814905 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7b41b196-2bb3-4dc3-98de-4dfd7bfa3676 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:40.814905 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7b41b196-2bb3-4dc3-98de-4dfd7bfa3676 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:40.815453 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-2235b152-ca26-4e89-acfa-70ac07bfaa1b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.510376 Aug 01 14:30:40.815453 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 509/1008] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:30:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:30:40.819726 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7b41b196-2bb3-4dc3-98de-4dfd7bfa3676 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:40.820788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7b41b196-2bb3-4dc3-98de-4dfd7bfa3676 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:40.822232 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7b41b196-2bb3-4dc3-98de-4dfd7bfa3676 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:40.822853 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7b41b196-2bb3-4dc3-98de-4dfd7bfa3676 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:40.842514 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c3f1f9e2-6c2f-4523-8b19-1dc4aed23cab tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:40.842514 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c3f1f9e2-6c2f-4523-8b19-1dc4aed23cab tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:40.876995 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7b41b196-2bb3-4dc3-98de-4dfd7bfa3676 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:40.877739 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7b41b196-2bb3-4dc3-98de-4dfd7bfa3676 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:40.878560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-7b41b196-2bb3-4dc3-98de-4dfd7bfa3676 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lazy-loading 'fault' on Instance uuid 6a377af0-0542-410e-93c3-e8c076f16ce6 {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:30:40.942041 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7b41b196-2bb3-4dc3-98de-4dfd7bfa3676 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:40.973727 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7b41b196-2bb3-4dc3-98de-4dfd7bfa3676 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 200 len: 1230 microversion: 2.1 time: 0.188087 Aug 01 14:30:40.978831 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 500/1009] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:40 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 1230 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:41.046990 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c3f1f9e2-6c2f-4523-8b19-1dc4aed23cab tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:41.051895 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c3f1f9e2-6c2f-4523-8b19-1dc4aed23cab tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1241 microversion: 2.1 time: 0.217782 Aug 01 14:30:41.074206 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 510/1010] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:40 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1241 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:41.636890 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-55d3cea4-541e-4ce7-ba36-bdeb6381b4e0 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:41.641016 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-55d3cea4-541e-4ce7-ba36-bdeb6381b4e0 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:41.696064 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-55d3cea4-541e-4ce7-ba36-bdeb6381b4e0 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:41.696064 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-55d3cea4-541e-4ce7-ba36-bdeb6381b4e0 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:41.696064 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-55d3cea4-541e-4ce7-ba36-bdeb6381b4e0 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:41.696064 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-55d3cea4-541e-4ce7-ba36-bdeb6381b4e0 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:41.873486 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-55d3cea4-541e-4ce7-ba36-bdeb6381b4e0 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:41.899791 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-55d3cea4-541e-4ce7-ba36-bdeb6381b4e0 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1356 microversion: 2.1 time: 0.273172 Aug 01 14:30:41.903211 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 501/1011] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:41 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1356 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:42.001421 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b7dc0136-7cec-4466-9af9-cf2de32f4808 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:42.002151 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b7dc0136-7cec-4466-9af9-cf2de32f4808 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:42.024892 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b7dc0136-7cec-4466-9af9-cf2de32f4808 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:42.028460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b7dc0136-7cec-4466-9af9-cf2de32f4808 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:42.052643 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b7dc0136-7cec-4466-9af9-cf2de32f4808 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:42.066163 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b7dc0136-7cec-4466-9af9-cf2de32f4808 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:42.075462 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-b7dc0136-7cec-4466-9af9-cf2de32f4808 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] HTTP exception thrown: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b7dc0136-7cec-4466-9af9-cf2de32f4808 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Request method failure captured: Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 HTTP/1.1 Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-LgBoQm9NvZLFBH-yE_GeuplVaQRb42-Xuimpm2ugydTxw7h7-9QWkFrt7vEpgW7P1Q11ML1sTN2o4o087oYdTKT4FIgIM6LjmAXCLwdVi1zhzM0jum_mcs2fL5KAxNQOM3G5J0vEz6yz_Iq3vUuga923dBcvYDq_OYMBn4-1BdQfI Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: 1d34ed67668c475695dbd57530aa6d49 Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-TestVolumeBootPattern-1973027885 Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:30:42.077858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:30:42.079410 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:30:42.079410 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-TestVolumeBootPattern-1973027885 Aug 01 14:30:42.079410 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: 1d34ed67668c475695dbd57530aa6d49 Aug 01 14:30:42.079410 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-TestVolumeBootPattern-1973027885 Aug 01 14:30:42.079410 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-TestVolumeBootPattern-1973027885-project Aug 01 14:30:42.079410 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:30:42.079410 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:30:42.079410 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: cc8d9f649a43450da28c0f7c2e4515ec Aug 01 14:30:42.079410 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-TestVolumeBootPattern-1973027885-project Aug 01 14:30:42.079410 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:30:42.079410 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. Aug 01 14:30:42.079410 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '6a377af0-0542-410e-93c3-e8c076f16ce6'} Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:30:42.080742 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. Aug 01 14:30:42.082340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:30:42.084529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-2bb4280f-ff8b-4587-869c-e6e56127f209 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:42.085003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b7dc0136-7cec-4466-9af9-cf2de32f4808 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Returning 404 to user: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:30:42.085143 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-2bb4280f-ff8b-4587-869c-e6e56127f209 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:42.086702 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b7dc0136-7cec-4466-9af9-cf2de32f4808 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 404 len: 111 microversion: 2.1 time: 0.089489 Aug 01 14:30:42.097307 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 511/1012] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:41 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:30:42.228014 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2bb4280f-ff8b-4587-869c-e6e56127f209 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:42.239771 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-2bb4280f-ff8b-4587-869c-e6e56127f209 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1241 microversion: 2.1 time: 0.159699 Aug 01 14:30:42.240645 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 502/1013] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:42 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1241 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:42.281666 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-20cd3c38-b0aa-4408-98f4-5158e259ae18 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-743870714", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-544331128", "security_groups": [{"name": "tempest-secgroup-smoke-1690971366"}], "block_device_mapping_v2": [{"uuid": "635ed620-8d76-4f88-bf8c-e900f22c77b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "30f01bf7-4722-4776-930d-9ee72a3389f9"}]}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:42.473118 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.network.neutron [None req-20cd3c38-b0aa-4408-98f4-5158e259ae18 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] validate_networks() for [('30f01bf7-4722-4776-930d-9ee72a3389f9', None, None, None, None, None)] {{(pid=118247) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:30:42.925022 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5769153c-429b-41b4-b7be-47e40ba1141e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:42.925683 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5769153c-429b-41b4-b7be-47e40ba1141e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:42.933361 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5769153c-429b-41b4-b7be-47e40ba1141e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:42.934812 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5769153c-429b-41b4-b7be-47e40ba1141e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:42.935769 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5769153c-429b-41b4-b7be-47e40ba1141e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:42.936370 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5769153c-429b-41b4-b7be-47e40ba1141e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:43.111516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-20cd3c38-b0aa-4408-98f4-5158e259ae18 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Flavor limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:30:43.112435 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-20cd3c38-b0aa-4408-98f4-5158e259ae18 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Image limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:30:43.112832 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-20cd3c38-b0aa-4408-98f4-5158e259ae18 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Flavor pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:30:43.113725 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-20cd3c38-b0aa-4408-98f4-5158e259ae18 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Image pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:30:43.114340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-20cd3c38-b0aa-4408-98f4-5158e259ae18 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:30:43.124268 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-20cd3c38-b0aa-4408-98f4-5158e259ae18 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:43.125117 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-20cd3c38-b0aa-4408-98f4-5158e259ae18 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:43.126278 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-20cd3c38-b0aa-4408-98f4-5158e259ae18 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:43.126961 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-20cd3c38-b0aa-4408-98f4-5158e259ae18 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:43.139306 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-5769153c-429b-41b4-b7be-47e40ba1141e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:43.148031 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5769153c-429b-41b4-b7be-47e40ba1141e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1356 microversion: 2.1 time: 0.227052 Aug 01 14:30:43.162213 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 503/1014] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:42 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1356 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:43.162327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-20cd3c38-b0aa-4408-98f4-5158e259ae18 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Getting quotas for project 1d34ed67668c475695dbd57530aa6d49. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:30:43.162327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:43.164044 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-20cd3c38-b0aa-4408-98f4-5158e259ae18 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Getting quotas for user cc8d9f649a43450da28c0f7c2e4515ec and project 1d34ed67668c475695dbd57530aa6d49. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:30:43.229228 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-20cd3c38-b0aa-4408-98f4-5158e259ae18 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Going to run 1 instances... {{(pid=118247) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:30:43.230567 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-20cd3c38-b0aa-4408-98f4-5158e259ae18 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='635ed620-8d76-4f88-bf8c-e900f22c77b1',volume_size=None,volume_type=None)] {{(pid=118247) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:30:43.261612 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-9135cea4-87d8-4c3d-8eaa-9c9af4e3e711 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:43.262405 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-9135cea4-87d8-4c3d-8eaa-9c9af4e3e711 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:43.269584 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9135cea4-87d8-4c3d-8eaa-9c9af4e3e711 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:43.270153 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9135cea4-87d8-4c3d-8eaa-9c9af4e3e711 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:43.271070 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9135cea4-87d8-4c3d-8eaa-9c9af4e3e711 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:43.271592 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9135cea4-87d8-4c3d-8eaa-9c9af4e3e711 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:43.535692 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-9135cea4-87d8-4c3d-8eaa-9c9af4e3e711 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:43.535692 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-9135cea4-87d8-4c3d-8eaa-9c9af4e3e711 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1245 microversion: 2.1 time: 0.093940 Aug 01 14:30:43.535692 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 504/1015] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:43 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:44.172089 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-a143a713-41d5-4b57-a44a-bdf27023f3f7 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:44.174018 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-a143a713-41d5-4b57-a44a-bdf27023f3f7 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:44.182381 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a143a713-41d5-4b57-a44a-bdf27023f3f7 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:44.182913 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a143a713-41d5-4b57-a44a-bdf27023f3f7 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:44.183781 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a143a713-41d5-4b57-a44a-bdf27023f3f7 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:44.184302 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a143a713-41d5-4b57-a44a-bdf27023f3f7 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:44.212415 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-20cd3c38-b0aa-4408-98f4-5158e259ae18 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.936686 Aug 01 14:30:44.220360 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 512/1016] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:30:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:30:44.227380 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-10a78d7e-f488-42b9-bd13-935e98f6f3aa tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:44.228210 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-10a78d7e-f488-42b9-bd13-935e98f6f3aa tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:44.331890 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-10a78d7e-f488-42b9-bd13-935e98f6f3aa tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:44.344622 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-10a78d7e-f488-42b9-bd13-935e98f6f3aa tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1093 microversion: 2.1 time: 0.122506 Aug 01 14:30:44.345203 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 513/1017] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:44 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1093 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:44.397533 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a143a713-41d5-4b57-a44a-bdf27023f3f7 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:44.406359 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-a143a713-41d5-4b57-a44a-bdf27023f3f7 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1356 microversion: 2.1 time: 0.238863 Aug 01 14:30:44.406989 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 505/1018] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:44 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1356 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:44.549449 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-72c433ea-22d6-4fe8-8960-118631c3f8ed tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:44.550373 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-72c433ea-22d6-4fe8-8960-118631c3f8ed tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:44.575699 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-72c433ea-22d6-4fe8-8960-118631c3f8ed tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:44.576276 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-72c433ea-22d6-4fe8-8960-118631c3f8ed tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:44.577125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-72c433ea-22d6-4fe8-8960-118631c3f8ed tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:44.577661 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-72c433ea-22d6-4fe8-8960-118631c3f8ed tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:44.646629 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-72c433ea-22d6-4fe8-8960-118631c3f8ed tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:44.655224 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-72c433ea-22d6-4fe8-8960-118631c3f8ed tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1245 microversion: 2.1 time: 0.109797 Aug 01 14:30:44.655792 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 514/1019] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:44 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1245 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:45.366234 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4bff8fdc-492f-4cdc-b9f7-c1ac8e522b2e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:45.366852 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4bff8fdc-492f-4cdc-b9f7-c1ac8e522b2e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:45.371262 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:45.375319 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4bff8fdc-492f-4cdc-b9f7-c1ac8e522b2e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:45.375775 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4bff8fdc-492f-4cdc-b9f7-c1ac8e522b2e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:45.376573 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4bff8fdc-492f-4cdc-b9f7-c1ac8e522b2e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:45.377015 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4bff8fdc-492f-4cdc-b9f7-c1ac8e522b2e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:45.432631 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-83dff529-c8c0-41b1-8bf9-059e9771884f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:45.434046 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-83dff529-c8c0-41b1-8bf9-059e9771884f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:45.441088 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-83dff529-c8c0-41b1-8bf9-059e9771884f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:45.441997 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-83dff529-c8c0-41b1-8bf9-059e9771884f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:45.443036 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-83dff529-c8c0-41b1-8bf9-059e9771884f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:45.443679 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-83dff529-c8c0-41b1-8bf9-059e9771884f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:45.451823 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4bff8fdc-492f-4cdc-b9f7-c1ac8e522b2e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:45.459517 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4bff8fdc-492f-4cdc-b9f7-c1ac8e522b2e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1143 microversion: 2.1 time: 0.097422 Aug 01 14:30:45.460341 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 506/1020] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:45 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1143 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:45.620565 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-83dff529-c8c0-41b1-8bf9-059e9771884f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:45.628040 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-83dff529-c8c0-41b1-8bf9-059e9771884f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1356 microversion: 2.1 time: 0.203237 Aug 01 14:30:45.628602 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 515/1021] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:45 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1356 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:45.676103 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-a01037e0-7797-48c1-9038-eeb6055fad5f tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:45.676709 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-a01037e0-7797-48c1-9038-eeb6055fad5f tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:45.683855 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a01037e0-7797-48c1-9038-eeb6055fad5f tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:45.684308 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a01037e0-7797-48c1-9038-eeb6055fad5f tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:45.685095 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a01037e0-7797-48c1-9038-eeb6055fad5f tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:45.685539 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a01037e0-7797-48c1-9038-eeb6055fad5f tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:45.750338 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a01037e0-7797-48c1-9038-eeb6055fad5f tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:45.766359 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-a01037e0-7797-48c1-9038-eeb6055fad5f tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1245 microversion: 2.1 time: 0.093986 Aug 01 14:30:45.767507 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 507/1022] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:45 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:46.480704 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a3ba23d5-ea79-477d-8f0a-deda061bd248 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:46.481261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a3ba23d5-ea79-477d-8f0a-deda061bd248 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:46.487861 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3ba23d5-ea79-477d-8f0a-deda061bd248 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:46.488581 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3ba23d5-ea79-477d-8f0a-deda061bd248 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:46.489346 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3ba23d5-ea79-477d-8f0a-deda061bd248 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:46.489805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3ba23d5-ea79-477d-8f0a-deda061bd248 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:46.551368 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a3ba23d5-ea79-477d-8f0a-deda061bd248 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:46.559281 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a3ba23d5-ea79-477d-8f0a-deda061bd248 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1143 microversion: 2.1 time: 0.082683 Aug 01 14:30:46.559834 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 516/1023] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:46 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:46.648541 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4cdb17d0-acde-4626-a4b7-c987316b1027 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:46.649157 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4cdb17d0-acde-4626-a4b7-c987316b1027 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:46.655563 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4cdb17d0-acde-4626-a4b7-c987316b1027 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:46.656018 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4cdb17d0-acde-4626-a4b7-c987316b1027 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:46.656793 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4cdb17d0-acde-4626-a4b7-c987316b1027 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:46.657229 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4cdb17d0-acde-4626-a4b7-c987316b1027 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:46.788183 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-77167692-85aa-4fc4-8b54-6669de59e48c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:46.789577 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-77167692-85aa-4fc4-8b54-6669de59e48c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:46.796198 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-77167692-85aa-4fc4-8b54-6669de59e48c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:46.796721 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4cdb17d0-acde-4626-a4b7-c987316b1027 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:46.796869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-77167692-85aa-4fc4-8b54-6669de59e48c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:46.798306 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-77167692-85aa-4fc4-8b54-6669de59e48c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:46.798914 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-77167692-85aa-4fc4-8b54-6669de59e48c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:46.807374 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4cdb17d0-acde-4626-a4b7-c987316b1027 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1356 microversion: 2.1 time: 0.163024 Aug 01 14:30:46.808487 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 508/1024] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:46 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:46.872585 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-77167692-85aa-4fc4-8b54-6669de59e48c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:46.880285 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-77167692-85aa-4fc4-8b54-6669de59e48c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1245 microversion: 2.1 time: 0.096022 Aug 01 14:30:46.880935 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 517/1025] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:46 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:47.581046 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e6cc6cba-af48-4278-a2f6-449d513b82c0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:47.581673 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e6cc6cba-af48-4278-a2f6-449d513b82c0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:47.588100 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e6cc6cba-af48-4278-a2f6-449d513b82c0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:47.588555 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e6cc6cba-af48-4278-a2f6-449d513b82c0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:47.589322 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e6cc6cba-af48-4278-a2f6-449d513b82c0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:47.590066 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e6cc6cba-af48-4278-a2f6-449d513b82c0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:47.651926 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e6cc6cba-af48-4278-a2f6-449d513b82c0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:47.659863 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e6cc6cba-af48-4278-a2f6-449d513b82c0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1135 microversion: 2.1 time: 0.082769 Aug 01 14:30:47.660427 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 509/1026] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:47 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1135 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:47.828603 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-38ae0871-dec4-458b-b6e4-eb2439322f0d tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:47.829214 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-38ae0871-dec4-458b-b6e4-eb2439322f0d tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:47.836382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-38ae0871-dec4-458b-b6e4-eb2439322f0d tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:47.836950 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-38ae0871-dec4-458b-b6e4-eb2439322f0d tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:47.837712 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-38ae0871-dec4-458b-b6e4-eb2439322f0d tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:47.838173 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-38ae0871-dec4-458b-b6e4-eb2439322f0d tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:47.901373 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-9b98f315-0a74-4cc3-a015-f77fdf15a9f5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:47.902095 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-9b98f315-0a74-4cc3-a015-f77fdf15a9f5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:47.908507 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9b98f315-0a74-4cc3-a015-f77fdf15a9f5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:47.909319 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9b98f315-0a74-4cc3-a015-f77fdf15a9f5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:47.910336 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9b98f315-0a74-4cc3-a015-f77fdf15a9f5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:47.910850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-9b98f315-0a74-4cc3-a015-f77fdf15a9f5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:47.981254 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-9b98f315-0a74-4cc3-a015-f77fdf15a9f5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:47.989155 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-9b98f315-0a74-4cc3-a015-f77fdf15a9f5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1237 microversion: 2.1 time: 0.091962 Aug 01 14:30:47.995846 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 510/1027] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:47 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:48.003584 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-38ae0871-dec4-458b-b6e4-eb2439322f0d tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:48.012241 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-38ae0871-dec4-458b-b6e4-eb2439322f0d tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1356 microversion: 2.1 time: 0.187479 Aug 01 14:30:48.012882 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 518/1028] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:47 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1356 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:48.681123 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-6c961801-7238-42b8-a2ad-2812d8a39859 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:48.681740 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-6c961801-7238-42b8-a2ad-2812d8a39859 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:48.688549 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6c961801-7238-42b8-a2ad-2812d8a39859 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:48.689086 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6c961801-7238-42b8-a2ad-2812d8a39859 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:48.689888 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6c961801-7238-42b8-a2ad-2812d8a39859 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:48.690330 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-6c961801-7238-42b8-a2ad-2812d8a39859 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:48.759919 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-6c961801-7238-42b8-a2ad-2812d8a39859 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:48.769885 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-6c961801-7238-42b8-a2ad-2812d8a39859 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1199 microversion: 2.1 time: 0.093112 Aug 01 14:30:48.770719 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 511/1029] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:48 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1199 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:49.014340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-2623692f-837c-4a46-b73c-db9008d71f19 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:49.015004 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-2623692f-837c-4a46-b73c-db9008d71f19 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:49.025245 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2623692f-837c-4a46-b73c-db9008d71f19 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:49.026280 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2623692f-837c-4a46-b73c-db9008d71f19 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:49.029874 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2623692f-837c-4a46-b73c-db9008d71f19 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:49.031187 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2623692f-837c-4a46-b73c-db9008d71f19 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:49.033483 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d445bb4e-bb09-4f75-92d2-a24beac0c8f8 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:49.034192 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d445bb4e-bb09-4f75-92d2-a24beac0c8f8 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:49.041963 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d445bb4e-bb09-4f75-92d2-a24beac0c8f8 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:49.042479 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d445bb4e-bb09-4f75-92d2-a24beac0c8f8 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:49.043578 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d445bb4e-bb09-4f75-92d2-a24beac0c8f8 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:49.043743 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d445bb4e-bb09-4f75-92d2-a24beac0c8f8 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:49.116374 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2623692f-837c-4a46-b73c-db9008d71f19 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:49.125001 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-2623692f-837c-4a46-b73c-db9008d71f19 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1301 microversion: 2.1 time: 0.117659 Aug 01 14:30:49.129446 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 519/1030] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:49 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1301 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:49.456439 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d445bb4e-bb09-4f75-92d2-a24beac0c8f8 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:49.465099 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d445bb4e-bb09-4f75-92d2-a24beac0c8f8 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1356 microversion: 2.1 time: 0.436192 Aug 01 14:30:49.465684 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 512/1031] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:49 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1356 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:49.792504 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7456ba64-4d0c-4dcb-8742-e06f30f74ccb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:49.793593 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7456ba64-4d0c-4dcb-8742-e06f30f74ccb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:49.801119 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7456ba64-4d0c-4dcb-8742-e06f30f74ccb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:49.801993 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7456ba64-4d0c-4dcb-8742-e06f30f74ccb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:49.802670 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7456ba64-4d0c-4dcb-8742-e06f30f74ccb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:49.803138 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7456ba64-4d0c-4dcb-8742-e06f30f74ccb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:49.881423 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7456ba64-4d0c-4dcb-8742-e06f30f74ccb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:49.890682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7456ba64-4d0c-4dcb-8742-e06f30f74ccb tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1209 microversion: 2.1 time: 0.103059 Aug 01 14:30:49.905227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 520/1032] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:49 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:50.147451 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-06ea23f0-1b19-495b-a756-c7e2ef5b70dc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:50.148085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-06ea23f0-1b19-495b-a756-c7e2ef5b70dc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:50.155723 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-06ea23f0-1b19-495b-a756-c7e2ef5b70dc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:50.156176 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-06ea23f0-1b19-495b-a756-c7e2ef5b70dc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:50.156954 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-06ea23f0-1b19-495b-a756-c7e2ef5b70dc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:50.157377 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-06ea23f0-1b19-495b-a756-c7e2ef5b70dc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:50.231485 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-06ea23f0-1b19-495b-a756-c7e2ef5b70dc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:50.233403 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-06ea23f0-1b19-495b-a756-c7e2ef5b70dc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1299 microversion: 2.1 time: 0.089634 Aug 01 14:30:50.238307 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 513/1033] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:50 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:50.490570 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-8e1c1a4e-4b26-46a0-bc14-b7ef2f7dade2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:50.492175 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-8e1c1a4e-4b26-46a0-bc14-b7ef2f7dade2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:50.500173 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8e1c1a4e-4b26-46a0-bc14-b7ef2f7dade2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:50.500865 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8e1c1a4e-4b26-46a0-bc14-b7ef2f7dade2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:50.501896 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8e1c1a4e-4b26-46a0-bc14-b7ef2f7dade2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:50.502597 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8e1c1a4e-4b26-46a0-bc14-b7ef2f7dade2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:50.662040 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-8e1c1a4e-4b26-46a0-bc14-b7ef2f7dade2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:50.670537 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-8e1c1a4e-4b26-46a0-bc14-b7ef2f7dade2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1356 microversion: 2.1 time: 0.186086 Aug 01 14:30:50.684277 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 521/1034] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:50 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1356 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:50.920151 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-38814a39-e929-450d-aff7-cfaf82e4599a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:50.920758 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-38814a39-e929-450d-aff7-cfaf82e4599a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:50.926933 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-38814a39-e929-450d-aff7-cfaf82e4599a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:50.927389 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-38814a39-e929-450d-aff7-cfaf82e4599a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:50.928149 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-38814a39-e929-450d-aff7-cfaf82e4599a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:50.928582 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-38814a39-e929-450d-aff7-cfaf82e4599a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:51.063378 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-38814a39-e929-450d-aff7-cfaf82e4599a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:51.071043 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-38814a39-e929-450d-aff7-cfaf82e4599a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1265 microversion: 2.1 time: 0.154850 Aug 01 14:30:51.071712 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 514/1035] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:50 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:51.255907 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c6478377-5aee-4b73-a1b4-afa42b854595 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:51.256378 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c6478377-5aee-4b73-a1b4-afa42b854595 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:51.263070 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c6478377-5aee-4b73-a1b4-afa42b854595 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:51.263455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c6478377-5aee-4b73-a1b4-afa42b854595 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:51.264226 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c6478377-5aee-4b73-a1b4-afa42b854595 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:51.264671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c6478377-5aee-4b73-a1b4-afa42b854595 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:51.394831 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c6478377-5aee-4b73-a1b4-afa42b854595 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:51.403748 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c6478377-5aee-4b73-a1b4-afa42b854595 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1367 microversion: 2.1 time: 0.151866 Aug 01 14:30:51.407344 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 522/1036] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:51 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:51.475176 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-fdf9cef3-8733-4333-af40-1487fdd1e854 req-28c712e3-62b6-4ceb-9c3c-c6f06c822986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6731b91-eec1-464e-aa85-217a2a172493", "tag": "a7fb0259-103e-4ba9-b56f-00ca293e5f4d"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:51.485824 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-fdf9cef3-8733-4333-af40-1487fdd1e854 req-28c712e3-62b6-4ceb-9c3c-c6f06c822986 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:51.486368 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-fdf9cef3-8733-4333-af40-1487fdd1e854 req-28c712e3-62b6-4ceb-9c3c-c6f06c822986 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:51.499161 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-fdf9cef3-8733-4333-af40-1487fdd1e854 req-28c712e3-62b6-4ceb-9c3c-c6f06c822986 service nova] Creating event network-changed:a7fb0259-103e-4ba9-b56f-00ca293e5f4d for instance b6731b91-eec1-464e-aa85-217a2a172493 on hv-cinder-78729 Aug 01 14:30:51.503961 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-fdf9cef3-8733-4333-af40-1487fdd1e854 req-28c712e3-62b6-4ceb-9c3c-c6f06c822986 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032759 Aug 01 14:30:51.504559 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 515/1037] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:51.692050 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-330921b3-67fd-4edf-b2be-6c0904288258 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:51.693288 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-330921b3-67fd-4edf-b2be-6c0904288258 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:51.700364 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-330921b3-67fd-4edf-b2be-6c0904288258 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:51.701042 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-330921b3-67fd-4edf-b2be-6c0904288258 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:51.701866 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-330921b3-67fd-4edf-b2be-6c0904288258 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:51.702305 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-330921b3-67fd-4edf-b2be-6c0904288258 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:51.866470 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-330921b3-67fd-4edf-b2be-6c0904288258 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:51.875548 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-330921b3-67fd-4edf-b2be-6c0904288258 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1356 microversion: 2.1 time: 0.187577 Aug 01 14:30:51.876642 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 523/1038] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:51 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1356 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:51.951980 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-f63a6444-f824-4cd7-9541-dfdc7764dea7 req-5be21eb8-d460-40f5-ab8e-d35c17e7b994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f818132-d74c-4e1d-80d2-26fbc8d68325", "name": "network-vif-plugged", "status": "completed", "tag": "2d661070-4d21-4715-be5d-845fc083bf67"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:51.967666 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-f63a6444-f824-4cd7-9541-dfdc7764dea7 req-5be21eb8-d460-40f5-ab8e-d35c17e7b994 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:51.968386 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-f63a6444-f824-4cd7-9541-dfdc7764dea7 req-5be21eb8-d460-40f5-ab8e-d35c17e7b994 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:51.981203 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-f63a6444-f824-4cd7-9541-dfdc7764dea7 req-5be21eb8-d460-40f5-ab8e-d35c17e7b994 service nova] Creating event network-vif-plugged:2d661070-4d21-4715-be5d-845fc083bf67 for instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 on hv-cinder-78729 Aug 01 14:30:51.986135 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-f63a6444-f824-4cd7-9541-dfdc7764dea7 req-5be21eb8-d460-40f5-ab8e-d35c17e7b994 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038129 Aug 01 14:30:51.986731 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 516/1039] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:52.093133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0d56b2af-33ad-4884-9f83-59a0edcbb10d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:52.093675 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0d56b2af-33ad-4884-9f83-59a0edcbb10d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:52.100021 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0d56b2af-33ad-4884-9f83-59a0edcbb10d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:52.100479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0d56b2af-33ad-4884-9f83-59a0edcbb10d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:52.101264 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0d56b2af-33ad-4884-9f83-59a0edcbb10d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:52.102372 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0d56b2af-33ad-4884-9f83-59a0edcbb10d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:52.240263 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0d56b2af-33ad-4884-9f83-59a0edcbb10d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:52.248604 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0d56b2af-33ad-4884-9f83-59a0edcbb10d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1265 microversion: 2.1 time: 0.159899 Aug 01 14:30:52.249188 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 524/1040] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:52 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:52.421807 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=14 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:52.426044 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-fbdea668-232f-4233-b120-96ac45e39ae9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:52.426825 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-fbdea668-232f-4233-b120-96ac45e39ae9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:52.433765 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fbdea668-232f-4233-b120-96ac45e39ae9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:52.436760 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fbdea668-232f-4233-b120-96ac45e39ae9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:52.436760 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fbdea668-232f-4233-b120-96ac45e39ae9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:52.436760 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-fbdea668-232f-4233-b120-96ac45e39ae9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:52.454635 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=100 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:52.575075 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-fbdea668-232f-4233-b120-96ac45e39ae9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:52.582744 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-fbdea668-232f-4233-b120-96ac45e39ae9 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1367 microversion: 2.1 time: 0.161919 Aug 01 14:30:52.583320 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 517/1041] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:52 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:52.897599 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-2c8f3bdb-117b-4780-8f9b-a210fc689725 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:52.898236 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-2c8f3bdb-117b-4780-8f9b-a210fc689725 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:52.904635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2c8f3bdb-117b-4780-8f9b-a210fc689725 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:52.905084 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2c8f3bdb-117b-4780-8f9b-a210fc689725 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:52.905868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2c8f3bdb-117b-4780-8f9b-a210fc689725 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:52.906304 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2c8f3bdb-117b-4780-8f9b-a210fc689725 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:53.034675 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-2c8f3bdb-117b-4780-8f9b-a210fc689725 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:53.043202 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-2c8f3bdb-117b-4780-8f9b-a210fc689725 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1356 microversion: 2.1 time: 0.149534 Aug 01 14:30:53.043755 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 525/1042] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:52 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:53.269572 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3315a277-bdb1-4d18-9a71-d2440b5686e3 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:53.270129 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3315a277-bdb1-4d18-9a71-d2440b5686e3 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:53.276738 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3315a277-bdb1-4d18-9a71-d2440b5686e3 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:53.277192 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3315a277-bdb1-4d18-9a71-d2440b5686e3 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:53.278020 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3315a277-bdb1-4d18-9a71-d2440b5686e3 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:53.278460 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3315a277-bdb1-4d18-9a71-d2440b5686e3 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:53.412163 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3315a277-bdb1-4d18-9a71-d2440b5686e3 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:53.419994 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3315a277-bdb1-4d18-9a71-d2440b5686e3 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1265 microversion: 2.1 time: 0.154458 Aug 01 14:30:53.420560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 518/1043] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:53 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:53.521075 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-ad1bbd84-2a4e-4e50-bb58-798be43ca7e2 req-e1ecb056-946b-4768-9bc6-a229b769907d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be92eb56-b7dd-481d-85ea-83ac3617db42", "tag": "8a784b0b-c5b0-4587-87f1-06d2000c3317"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:53.526586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=6 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:53.531861 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-ad1bbd84-2a4e-4e50-bb58-798be43ca7e2 req-e1ecb056-946b-4768-9bc6-a229b769907d service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:53.532303 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-ad1bbd84-2a4e-4e50-bb58-798be43ca7e2 req-e1ecb056-946b-4768-9bc6-a229b769907d service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:53.543002 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-ad1bbd84-2a4e-4e50-bb58-798be43ca7e2 req-e1ecb056-946b-4768-9bc6-a229b769907d service nova] Creating event network-changed:8a784b0b-c5b0-4587-87f1-06d2000c3317 for instance be92eb56-b7dd-481d-85ea-83ac3617db42 on hv-cinder-78729 Aug 01 14:30:53.548133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-ad1bbd84-2a4e-4e50-bb58-798be43ca7e2 req-e1ecb056-946b-4768-9bc6-a229b769907d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030667 Aug 01 14:30:53.548697 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 526/1044] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:53.608542 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-14354dec-a959-42c1-be7b-068063ced443 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:53.609256 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-14354dec-a959-42c1-be7b-068063ced443 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:53.615988 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-14354dec-a959-42c1-be7b-068063ced443 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:53.616436 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-14354dec-a959-42c1-be7b-068063ced443 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:53.617378 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-14354dec-a959-42c1-be7b-068063ced443 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:53.618106 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-14354dec-a959-42c1-be7b-068063ced443 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:53.746066 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-14354dec-a959-42c1-be7b-068063ced443 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:53.753464 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-14354dec-a959-42c1-be7b-068063ced443 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1367 microversion: 2.1 time: 0.148685 Aug 01 14:30:53.754058 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 519/1045] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:53 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:54.065494 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-bc66785c-3371-4018-a1e8-887826c81803 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:54.066221 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-bc66785c-3371-4018-a1e8-887826c81803 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:54.073198 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bc66785c-3371-4018-a1e8-887826c81803 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:54.073681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bc66785c-3371-4018-a1e8-887826c81803 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:54.074455 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bc66785c-3371-4018-a1e8-887826c81803 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:54.074897 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bc66785c-3371-4018-a1e8-887826c81803 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:54.201745 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bc66785c-3371-4018-a1e8-887826c81803 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:54.209096 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-bc66785c-3371-4018-a1e8-887826c81803 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1356 microversion: 2.1 time: 0.148691 Aug 01 14:30:54.209621 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 527/1046] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:54 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:54.441439 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5231eb37-16c6-4df9-a697-85798729248e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:54.442247 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5231eb37-16c6-4df9-a697-85798729248e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:54.448738 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5231eb37-16c6-4df9-a697-85798729248e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:54.449181 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5231eb37-16c6-4df9-a697-85798729248e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:54.449999 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5231eb37-16c6-4df9-a697-85798729248e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:54.450438 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5231eb37-16c6-4df9-a697-85798729248e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:54.592202 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-5231eb37-16c6-4df9-a697-85798729248e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:54.599571 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5231eb37-16c6-4df9-a697-85798729248e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1265 microversion: 2.1 time: 0.162935 Aug 01 14:30:54.600136 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 520/1047] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:54 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:54.774900 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4effb93f-632c-4b16-88d4-de46dda3d6a5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:54.775525 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-4effb93f-632c-4b16-88d4-de46dda3d6a5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:54.777460 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=22 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:54.782497 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4effb93f-632c-4b16-88d4-de46dda3d6a5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:54.783433 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4effb93f-632c-4b16-88d4-de46dda3d6a5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:54.783707 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4effb93f-632c-4b16-88d4-de46dda3d6a5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:54.784154 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4effb93f-632c-4b16-88d4-de46dda3d6a5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:54.788514 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=100 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:54.921132 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-4effb93f-632c-4b16-88d4-de46dda3d6a5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:54.928913 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4effb93f-632c-4b16-88d4-de46dda3d6a5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1367 microversion: 2.1 time: 0.158227 Aug 01 14:30:54.929704 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 528/1048] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:54 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:55.230432 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b95e011c-57a0-4c88-8ed6-9aa1fdeb143b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:55.231090 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b95e011c-57a0-4c88-8ed6-9aa1fdeb143b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:55.237527 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b95e011c-57a0-4c88-8ed6-9aa1fdeb143b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:55.238276 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b95e011c-57a0-4c88-8ed6-9aa1fdeb143b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:55.239103 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b95e011c-57a0-4c88-8ed6-9aa1fdeb143b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:55.239569 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b95e011c-57a0-4c88-8ed6-9aa1fdeb143b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:55.381592 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-b95e011c-57a0-4c88-8ed6-9aa1fdeb143b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:55.391044 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b95e011c-57a0-4c88-8ed6-9aa1fdeb143b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1546 microversion: 2.1 time: 0.165139 Aug 01 14:30:55.391886 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 521/1049] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:55 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1546 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:55.411384 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-539ac792-0d6b-451c-bcef-b286b169f944 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:55.411984 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-539ac792-0d6b-451c-bcef-b286b169f944 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:55.418991 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-539ac792-0d6b-451c-bcef-b286b169f944 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:55.419448 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-539ac792-0d6b-451c-bcef-b286b169f944 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:55.420230 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-539ac792-0d6b-451c-bcef-b286b169f944 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:55.420673 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-539ac792-0d6b-451c-bcef-b286b169f944 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:55.562512 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-539ac792-0d6b-451c-bcef-b286b169f944 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:55.571625 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-539ac792-0d6b-451c-bcef-b286b169f944 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1546 microversion: 2.1 time: 0.162771 Aug 01 14:30:55.572156 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 529/1050] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:55 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1546 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:55.591834 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-bfe71c60-7f4b-4b9c-9235-272b7a810eef tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:55.596687 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-bfe71c60-7f4b-4b9c-9235-272b7a810eef tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:55.597449 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-bfe71c60-7f4b-4b9c-9235-272b7a810eef tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Searching by: {'deleted': False, 'project_id': '937e807649094f70844259eafaef26b1'} {{(pid=118246) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 01 14:30:55.604913 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bfe71c60-7f4b-4b9c-9235-272b7a810eef tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:55.605366 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bfe71c60-7f4b-4b9c-9235-272b7a810eef tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:55.606206 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bfe71c60-7f4b-4b9c-9235-272b7a810eef tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:55.606643 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-bfe71c60-7f4b-4b9c-9235-272b7a810eef tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:55.622244 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d8b88335-f27f-41a1-bf09-3ccb15bcd1f8 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:55.622939 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d8b88335-f27f-41a1-bf09-3ccb15bcd1f8 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:55.629635 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d8b88335-f27f-41a1-bf09-3ccb15bcd1f8 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:55.630537 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d8b88335-f27f-41a1-bf09-3ccb15bcd1f8 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:55.631485 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d8b88335-f27f-41a1-bf09-3ccb15bcd1f8 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:55.631990 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d8b88335-f27f-41a1-bf09-3ccb15bcd1f8 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:55.703640 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.multi_cell_list [None req-bfe71c60-7f4b-4b9c-9235-272b7a810eef tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118246) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 01 14:30:55.793608 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d8b88335-f27f-41a1-bf09-3ccb15bcd1f8 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:55.802141 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d8b88335-f27f-41a1-bf09-3ccb15bcd1f8 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1265 microversion: 2.1 time: 0.184979 Aug 01 14:30:55.803316 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 530/1051] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:55 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:55.835534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-bfe71c60-7f4b-4b9c-9235-272b7a810eef tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.244838 Aug 01 14:30:55.835534 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 522/1052] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Aug 1 14:30:55 2022] GET /compute/v2.1/servers => generated 341 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:30:55.845783 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-9a69e3ff-e7c3-4e59-b50f-ca848caaaf09 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:55.846507 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-9a69e3ff-e7c3-4e59-b50f-ca848caaaf09 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:55.853059 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9a69e3ff-e7c3-4e59-b50f-ca848caaaf09 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:55.853959 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9a69e3ff-e7c3-4e59-b50f-ca848caaaf09 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:55.854774 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9a69e3ff-e7c3-4e59-b50f-ca848caaaf09 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:55.855222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9a69e3ff-e7c3-4e59-b50f-ca848caaaf09 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:55.949864 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-22c91e46-de73-478e-bd3a-b788237a3e5a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:55.950674 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-22c91e46-de73-478e-bd3a-b788237a3e5a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:55.964302 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-22c91e46-de73-478e-bd3a-b788237a3e5a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:55.965210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-22c91e46-de73-478e-bd3a-b788237a3e5a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:55.966158 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-22c91e46-de73-478e-bd3a-b788237a3e5a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:55.966802 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-22c91e46-de73-478e-bd3a-b788237a3e5a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:56.019043 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-9a69e3ff-e7c3-4e59-b50f-ca848caaaf09 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:56.030385 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-9a69e3ff-e7c3-4e59-b50f-ca848caaaf09 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1546 microversion: 2.1 time: 0.186420 Aug 01 14:30:56.031075 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 531/1053] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:55 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1546 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:56.161213 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-22c91e46-de73-478e-bd3a-b788237a3e5a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:56.173536 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-22c91e46-de73-478e-bd3a-b788237a3e5a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1367 microversion: 2.1 time: 0.227124 Aug 01 14:30:56.183113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 523/1054] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:55 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:56.373428 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7e0d459d-e7c9-4476-9e84-f17e3d1beaa2 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:56.373997 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7e0d459d-e7c9-4476-9e84-f17e3d1beaa2 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:56.379499 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-5d748d91-26f6-4401-9d3b-bd16f10bfc67 req-73aa0479-b151-46b7-b31d-906b376c0d01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4551bd54-cfbb-4d79-913e-6380a1e0f5f1", "tag": "2824ee5e-b738-4db9-80e9-f6a993f7e7af"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:56.380787 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7e0d459d-e7c9-4476-9e84-f17e3d1beaa2 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:56.381248 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7e0d459d-e7c9-4476-9e84-f17e3d1beaa2 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:56.382054 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7e0d459d-e7c9-4476-9e84-f17e3d1beaa2 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:56.382502 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7e0d459d-e7c9-4476-9e84-f17e3d1beaa2 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:56.391449 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-5d748d91-26f6-4401-9d3b-bd16f10bfc67 req-73aa0479-b151-46b7-b31d-906b376c0d01 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:56.391982 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-5d748d91-26f6-4401-9d3b-bd16f10bfc67 req-73aa0479-b151-46b7-b31d-906b376c0d01 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:56.406030 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-5d748d91-26f6-4401-9d3b-bd16f10bfc67 req-73aa0479-b151-46b7-b31d-906b376c0d01 service nova] Creating event network-changed:2824ee5e-b738-4db9-80e9-f6a993f7e7af for instance 4551bd54-cfbb-4d79-913e-6380a1e0f5f1 on hv-cinder-78729 Aug 01 14:30:56.409556 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7e0d459d-e7c9-4476-9e84-f17e3d1beaa2 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Going to try to terminate instance {{(pid=118247) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:30:56.411916 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-5d748d91-26f6-4401-9d3b-bd16f10bfc67 req-73aa0479-b151-46b7-b31d-906b376c0d01 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036457 Aug 01 14:30:56.412415 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 524/1055] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:56.725648 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7e0d459d-e7c9-4476-9e84-f17e3d1beaa2 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 204 len: 0 microversion: 2.1 time: 0.355963 Aug 01 14:30:56.726829 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 532/1056] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:30:56 2022] DELETE /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:30:56.739786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7cfecf31-079a-491f-b2a8-afcbbf893cdf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:56.739786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7cfecf31-079a-491f-b2a8-afcbbf893cdf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:56.745893 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7cfecf31-079a-491f-b2a8-afcbbf893cdf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:56.746643 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7cfecf31-079a-491f-b2a8-afcbbf893cdf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:56.747652 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7cfecf31-079a-491f-b2a8-afcbbf893cdf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:56.748322 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7cfecf31-079a-491f-b2a8-afcbbf893cdf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:56.825805 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e2bf40ca-154a-43c7-aab4-ac72164a1318 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:56.826776 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e2bf40ca-154a-43c7-aab4-ac72164a1318 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:56.839914 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e2bf40ca-154a-43c7-aab4-ac72164a1318 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:56.840527 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e2bf40ca-154a-43c7-aab4-ac72164a1318 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:56.844676 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e2bf40ca-154a-43c7-aab4-ac72164a1318 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:56.845437 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e2bf40ca-154a-43c7-aab4-ac72164a1318 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:56.994841 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7cfecf31-079a-491f-b2a8-afcbbf893cdf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:57.004320 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7cfecf31-079a-491f-b2a8-afcbbf893cdf tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1567 microversion: 2.1 time: 0.272804 Aug 01 14:30:57.005530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 525/1057] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:56 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:57.028497 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e2bf40ca-154a-43c7-aab4-ac72164a1318 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:57.036086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e2bf40ca-154a-43c7-aab4-ac72164a1318 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1265 microversion: 2.1 time: 0.215653 Aug 01 14:30:57.036652 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 533/1058] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:56 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:57.194625 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-36d09562-9220-4d46-8164-d6d65f321fdf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:57.195984 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-36d09562-9220-4d46-8164-d6d65f321fdf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:57.202762 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-36d09562-9220-4d46-8164-d6d65f321fdf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:57.203305 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-36d09562-9220-4d46-8164-d6d65f321fdf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:57.204162 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-36d09562-9220-4d46-8164-d6d65f321fdf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:57.204675 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-36d09562-9220-4d46-8164-d6d65f321fdf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:57.344242 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-36d09562-9220-4d46-8164-d6d65f321fdf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:57.353570 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-36d09562-9220-4d46-8164-d6d65f321fdf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1367 microversion: 2.1 time: 0.162653 Aug 01 14:30:57.354181 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 526/1059] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:57 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:57.985325 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c83015f4-7fee-4765-8342-67b62239cc76 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b758cc3f-2728-430c-802b-ee20b328aa0e"}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:57.993741 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c83015f4-7fee-4765-8342-67b62239cc76 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:57.995047 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c83015f4-7fee-4765-8342-67b62239cc76 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:57.995512 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c83015f4-7fee-4765-8342-67b62239cc76 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:57.996302 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c83015f4-7fee-4765-8342-67b62239cc76 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:57.996752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c83015f4-7fee-4765-8342-67b62239cc76 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:58.016705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-09d519cb-4a29-41ca-865c-0a1dd798bed1 req-eb2feaed-f7cd-4a28-b63a-19958a09c022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be92eb56-b7dd-481d-85ea-83ac3617db42", "name": "network-vif-plugged", "status": "completed", "tag": "8a784b0b-c5b0-4587-87f1-06d2000c3317"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:58.025429 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-09d519cb-4a29-41ca-865c-0a1dd798bed1 req-eb2feaed-f7cd-4a28-b63a-19958a09c022 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:58.025908 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-09d519cb-4a29-41ca-865c-0a1dd798bed1 req-eb2feaed-f7cd-4a28-b63a-19958a09c022 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:58.045800 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-09d519cb-4a29-41ca-865c-0a1dd798bed1 req-eb2feaed-f7cd-4a28-b63a-19958a09c022 service nova] Creating event network-vif-plugged:8a784b0b-c5b0-4587-87f1-06d2000c3317 for instance be92eb56-b7dd-481d-85ea-83ac3617db42 on hv-cinder-78729 Aug 01 14:30:58.050715 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-09d519cb-4a29-41ca-865c-0a1dd798bed1 req-eb2feaed-f7cd-4a28-b63a-19958a09c022 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041596 Aug 01 14:30:58.051317 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 527/1060] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:58.057068 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-deb71b91-ad90-43ba-9a24-e7c7c88ceaaa tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:58.057790 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-deb71b91-ad90-43ba-9a24-e7c7c88ceaaa tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:58.064018 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-deb71b91-ad90-43ba-9a24-e7c7c88ceaaa tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:58.064445 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-deb71b91-ad90-43ba-9a24-e7c7c88ceaaa tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:58.065411 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-deb71b91-ad90-43ba-9a24-e7c7c88ceaaa tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:58.066064 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-deb71b91-ad90-43ba-9a24-e7c7c88ceaaa tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:58.210447 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-deb71b91-ad90-43ba-9a24-e7c7c88ceaaa tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:58.218847 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-deb71b91-ad90-43ba-9a24-e7c7c88ceaaa tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1567 microversion: 2.1 time: 0.166117 Aug 01 14:30:58.219410 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 528/1061] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:58 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:58.223803 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7b6156ef-cef1-414c-8738-ded296060cd5 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:58.224410 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7b6156ef-cef1-414c-8738-ded296060cd5 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:58.230242 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7b6156ef-cef1-414c-8738-ded296060cd5 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:58.230725 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7b6156ef-cef1-414c-8738-ded296060cd5 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:58.231499 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7b6156ef-cef1-414c-8738-ded296060cd5 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:58.231943 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7b6156ef-cef1-414c-8738-ded296060cd5 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:58.368776 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7b6156ef-cef1-414c-8738-ded296060cd5 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:58.377176 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7b6156ef-cef1-414c-8738-ded296060cd5 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1265 microversion: 2.1 time: 0.156760 Aug 01 14:30:58.377957 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 529/1062] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:58 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:58.382383 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-17e16dd4-e734-4974-a3cf-42b36496b196 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:58.383661 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-17e16dd4-e734-4974-a3cf-42b36496b196 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:58.389624 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-17e16dd4-e734-4974-a3cf-42b36496b196 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:58.390311 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-17e16dd4-e734-4974-a3cf-42b36496b196 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:58.391256 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-17e16dd4-e734-4974-a3cf-42b36496b196 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:58.391928 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-17e16dd4-e734-4974-a3cf-42b36496b196 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:58.528681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-17e16dd4-e734-4974-a3cf-42b36496b196 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:58.536251 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-17e16dd4-e734-4974-a3cf-42b36496b196 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1367 microversion: 2.1 time: 0.157380 Aug 01 14:30:58.536843 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 530/1063] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:58 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:59.013515 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c83015f4-7fee-4765-8342-67b62239cc76 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "POST /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.032167 Aug 01 14:30:59.014450 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 534/1064] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Aug 1 14:30:57 2022] POST /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/os-volume_attachments => generated 194 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:59.240973 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8e7bd5bd-0823-4ae0-929a-1dbba299c070 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:59.241815 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8e7bd5bd-0823-4ae0-929a-1dbba299c070 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:59.247939 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8e7bd5bd-0823-4ae0-929a-1dbba299c070 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:59.248477 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8e7bd5bd-0823-4ae0-929a-1dbba299c070 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:59.249317 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8e7bd5bd-0823-4ae0-929a-1dbba299c070 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:59.249887 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-8e7bd5bd-0823-4ae0-929a-1dbba299c070 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:59.388484 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8e7bd5bd-0823-4ae0-929a-1dbba299c070 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:59.396386 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8e7bd5bd-0823-4ae0-929a-1dbba299c070 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1449 microversion: 2.1 time: 0.159682 Aug 01 14:30:59.396944 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 531/1065] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:59 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:30:59.401325 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a3ccb2f2-7aa7-4b3d-8954-849e22315ed1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:59.402098 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a3ccb2f2-7aa7-4b3d-8954-849e22315ed1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:59.408478 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3ccb2f2-7aa7-4b3d-8954-849e22315ed1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:59.408945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3ccb2f2-7aa7-4b3d-8954-849e22315ed1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:59.409837 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3ccb2f2-7aa7-4b3d-8954-849e22315ed1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:59.410302 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a3ccb2f2-7aa7-4b3d-8954-849e22315ed1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:59.540646 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-795fdf2d-70c7-4424-b222-f51b319c34c1 req-9e70167f-ac16-4f16-9b7a-fe53987e339e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4551bd54-cfbb-4d79-913e-6380a1e0f5f1", "name": "network-vif-deleted", "tag": "2824ee5e-b738-4db9-80e9-f6a993f7e7af"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:30:59.551849 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-795fdf2d-70c7-4424-b222-f51b319c34c1 req-9e70167f-ac16-4f16-9b7a-fe53987e339e service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:59.551849 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-795fdf2d-70c7-4424-b222-f51b319c34c1 req-9e70167f-ac16-4f16-9b7a-fe53987e339e service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:59.557222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a3ccb2f2-7aa7-4b3d-8954-849e22315ed1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:59.564091 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a3ccb2f2-7aa7-4b3d-8954-849e22315ed1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1265 microversion: 2.1 time: 0.168732 Aug 01 14:30:59.564659 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 535/1066] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:59 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:30:59.569278 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-699a68ae-2830-4a48-b495-3c01e387f8cf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:30:59.570734 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-699a68ae-2830-4a48-b495-3c01e387f8cf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:30:59.577981 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-699a68ae-2830-4a48-b495-3c01e387f8cf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:59.578520 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-699a68ae-2830-4a48-b495-3c01e387f8cf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:59.579379 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-699a68ae-2830-4a48-b495-3c01e387f8cf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:30:59.579915 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-699a68ae-2830-4a48-b495-3c01e387f8cf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:30:59.582558 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-795fdf2d-70c7-4424-b222-f51b319c34c1 req-9e70167f-ac16-4f16-9b7a-fe53987e339e service nova] Creating event network-vif-deleted:2824ee5e-b738-4db9-80e9-f6a993f7e7af for instance 4551bd54-cfbb-4d79-913e-6380a1e0f5f1 on hv-cinder-78729 Aug 01 14:30:59.588784 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-795fdf2d-70c7-4424-b222-f51b319c34c1 req-9e70167f-ac16-4f16-9b7a-fe53987e339e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052945 Aug 01 14:30:59.589388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 532/1067] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:30:59.713031 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-699a68ae-2830-4a48-b495-3c01e387f8cf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:30:59.720589 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-699a68ae-2830-4a48-b495-3c01e387f8cf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1367 microversion: 2.1 time: 0.154737 Aug 01 14:30:59.721213 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 536/1068] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:30:59 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:00.418323 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d639cd66-a492-4527-920e-9740c30492de tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:00.418936 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d639cd66-a492-4527-920e-9740c30492de tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:00.425211 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d639cd66-a492-4527-920e-9740c30492de tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:00.432036 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d639cd66-a492-4527-920e-9740c30492de tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:00.432036 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d639cd66-a492-4527-920e-9740c30492de tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:00.432036 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d639cd66-a492-4527-920e-9740c30492de tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:00.493879 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d639cd66-a492-4527-920e-9740c30492de tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:00.502429 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d639cd66-a492-4527-920e-9740c30492de tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1219 microversion: 2.1 time: 0.088467 Aug 01 14:31:00.503314 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 533/1069] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:00 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:00.584759 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-97df4f1d-d87e-419d-b541-87538e048d2a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:00.585351 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-97df4f1d-d87e-419d-b541-87538e048d2a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:00.591974 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-97df4f1d-d87e-419d-b541-87538e048d2a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:00.598605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-97df4f1d-d87e-419d-b541-87538e048d2a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:00.598605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-97df4f1d-d87e-419d-b541-87538e048d2a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:00.598605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-97df4f1d-d87e-419d-b541-87538e048d2a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:00.731100 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-97df4f1d-d87e-419d-b541-87538e048d2a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:00.740548 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-97df4f1d-d87e-419d-b541-87538e048d2a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1265 microversion: 2.1 time: 0.159628 Aug 01 14:31:00.741123 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 537/1070] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:00 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:31:00.743001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4093a392-5e3d-4e19-9044-8d389851cbcd tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:00.743821 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4093a392-5e3d-4e19-9044-8d389851cbcd tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:00.750256 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4093a392-5e3d-4e19-9044-8d389851cbcd tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:00.750713 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4093a392-5e3d-4e19-9044-8d389851cbcd tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:00.751484 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4093a392-5e3d-4e19-9044-8d389851cbcd tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:00.751924 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4093a392-5e3d-4e19-9044-8d389851cbcd tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:00.885373 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4093a392-5e3d-4e19-9044-8d389851cbcd tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:00.892936 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4093a392-5e3d-4e19-9044-8d389851cbcd tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1557 microversion: 2.1 time: 0.154675 Aug 01 14:31:00.893503 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 534/1071] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:00 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:31:00.915112 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3945eb68-507b-4518-9899-d15f79f66cd5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:00.915606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3945eb68-507b-4518-9899-d15f79f66cd5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:00.921641 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3945eb68-507b-4518-9899-d15f79f66cd5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:00.922162 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3945eb68-507b-4518-9899-d15f79f66cd5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:00.922933 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3945eb68-507b-4518-9899-d15f79f66cd5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:00.923370 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3945eb68-507b-4518-9899-d15f79f66cd5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:01.000877 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3945eb68-507b-4518-9899-d15f79f66cd5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090185 Aug 01 14:31:01.001471 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 538/1072] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Aug 1 14:31:00 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:31:01.526247 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-202759a8-2fa3-4278-9b97-3c74965c6414 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:01.526860 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-202759a8-2fa3-4278-9b97-3c74965c6414 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:01.533587 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-202759a8-2fa3-4278-9b97-3c74965c6414 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:01.534069 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-202759a8-2fa3-4278-9b97-3c74965c6414 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:01.534839 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-202759a8-2fa3-4278-9b97-3c74965c6414 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:01.535273 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-202759a8-2fa3-4278-9b97-3c74965c6414 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:01.579899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-202759a8-2fa3-4278-9b97-3c74965c6414 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:01.580638 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-202759a8-2fa3-4278-9b97-3c74965c6414 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:01.581113 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-202759a8-2fa3-4278-9b97-3c74965c6414 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lazy-loading 'fault' on Instance uuid 4551bd54-cfbb-4d79-913e-6380a1e0f5f1 {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:31:01.584031 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=100 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:01.656916 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-202759a8-2fa3-4278-9b97-3c74965c6414 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2ef56494054dd2ac1c18bee82f2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c982cea0e664473ca8df5da87fbe6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:01.664842 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-202759a8-2fa3-4278-9b97-3c74965c6414 tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 200 len: 1224 microversion: 2.1 time: 0.143350 Aug 01 14:31:01.665434 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 535/1073] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:01 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 1224 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:01.763494 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d9458426-d7f5-49bd-9c51-87086b868db5 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:01.764013 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-d9458426-d7f5-49bd-9c51-87086b868db5 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:01.770275 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d9458426-d7f5-49bd-9c51-87086b868db5 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:01.770728 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d9458426-d7f5-49bd-9c51-87086b868db5 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:01.771523 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d9458426-d7f5-49bd-9c51-87086b868db5 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:01.771957 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-d9458426-d7f5-49bd-9c51-87086b868db5 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:01.988885 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-d9458426-d7f5-49bd-9c51-87086b868db5 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:01.997453 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d9458426-d7f5-49bd-9c51-87086b868db5 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1265 microversion: 2.1 time: 0.238552 Aug 01 14:31:01.998067 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 539/1074] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:01 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:02.146179 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-17f0762b-8345-47a4-915c-3b5f6d202220 req-496f6cb9-5da1-444c-a17d-7ca3d25340f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be92eb56-b7dd-481d-85ea-83ac3617db42", "tag": "8a784b0b-c5b0-4587-87f1-06d2000c3317"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:31:02.158325 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-17f0762b-8345-47a4-915c-3b5f6d202220 req-496f6cb9-5da1-444c-a17d-7ca3d25340f1 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:02.159055 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-17f0762b-8345-47a4-915c-3b5f6d202220 req-496f6cb9-5da1-444c-a17d-7ca3d25340f1 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:02.182532 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-17f0762b-8345-47a4-915c-3b5f6d202220 req-496f6cb9-5da1-444c-a17d-7ca3d25340f1 service nova] Creating event network-changed:8a784b0b-c5b0-4587-87f1-06d2000c3317 for instance be92eb56-b7dd-481d-85ea-83ac3617db42 on hv-cinder-78729 Aug 01 14:31:02.188090 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-17f0762b-8345-47a4-915c-3b5f6d202220 req-496f6cb9-5da1-444c-a17d-7ca3d25340f1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045715 Aug 01 14:31:02.188968 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 536/1075] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:31:02.687284 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ebc2f330-8787-4678-b729-e47ef8fd80ec tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:02.687936 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ebc2f330-8787-4678-b729-e47ef8fd80ec tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] [instance: 4551bd54-cfbb-4d79-913e-6380a1e0f5f1] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:02.694516 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ebc2f330-8787-4678-b729-e47ef8fd80ec tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:02.695032 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ebc2f330-8787-4678-b729-e47ef8fd80ec tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:02.696058 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ebc2f330-8787-4678-b729-e47ef8fd80ec tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:02.696501 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ebc2f330-8787-4678-b729-e47ef8fd80ec tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:02.710826 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-ebc2f330-8787-4678-b729-e47ef8fd80ec tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] HTTP exception thrown: Instance 4551bd54-cfbb-4d79-913e-6380a1e0f5f1 could not be found. Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ebc2f330-8787-4678-b729-e47ef8fd80ec tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Request method failure captured: Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 HTTP/1.1 Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-J1zqqVPV5bSsXofNjonmJ6P3qo9gTY3tmWPctPvQBwtpVLbnAWPw2I29tYQpZlSrwIKE1rkeNFGp-q4Oy06sB-ONYiKNPwsTnNgscSzRVLhmP8lvJxFdy0Y4gEnT3luXN1XNXFpK5LqptrOS51Q41SXB7KY37w-QJhT_WhZrbGpi0 Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: c982cea0e664473ca8df5da87fbe6d73 Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-TestShelveInstance-1030248060 Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:31:02.712626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:31:02.714392 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c982cea0e664473ca8df5da87fbe6d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c982cea0e664473ca8df5da87fbe6d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c982cea0e664473ca8df5da87fbe6d73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c982cea0e664473ca8df5da87fbe6d73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:31:02.714392 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-TestShelveInstance-1030248060 Aug 01 14:31:02.714392 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: c982cea0e664473ca8df5da87fbe6d73 Aug 01 14:31:02.714392 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-TestShelveInstance-1030248060 Aug 01 14:31:02.714392 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-TestShelveInstance-1030248060-project Aug 01 14:31:02.714392 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:31:02.714392 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:31:02.714392 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: cb2ef56494054dd2ac1c18bee82f2a25 Aug 01 14:31:02.714392 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-TestShelveInstance-1030248060-project Aug 01 14:31:02.714392 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:31:02.714392 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 4551bd54-cfbb-4d79-913e-6380a1e0f5f1 could not be found. Aug 01 14:31:02.714392 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '4551bd54-cfbb-4d79-913e-6380a1e0f5f1'} Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4551bd54-cfbb-4d79-913e-6380a1e0f5f1 could not be found. Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:31:02.715271 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4551bd54-cfbb-4d79-913e-6380a1e0f5f1 could not be found. Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4551bd54-cfbb-4d79-913e-6380a1e0f5f1 could not be found. Aug 01 14:31:02.716586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:31:02.719290 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ebc2f330-8787-4678-b729-e47ef8fd80ec tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Returning 404 to user: Instance 4551bd54-cfbb-4d79-913e-6380a1e0f5f1 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:31:02.720227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ebc2f330-8787-4678-b729-e47ef8fd80ec tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1" status: 404 len: 111 microversion: 2.1 time: 0.037645 Aug 01 14:31:02.721044 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 540/1076] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:02 2022] GET /compute/v2.1/servers/4551bd54-cfbb-4d79-913e-6380a1e0f5f1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:31:02.965084 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-9ce79700-f962-43ff-aa50-74c02fa8ba4c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] Calling method '.version_select at 0x7fb254042430>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:03.018307 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-909ecc02-6d93-4b51-9a7c-4f4920ef3335 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:03.018745 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-909ecc02-6d93-4b51-9a7c-4f4920ef3335 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:03.026421 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-909ecc02-6d93-4b51-9a7c-4f4920ef3335 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:03.026882 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-909ecc02-6d93-4b51-9a7c-4f4920ef3335 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:03.027821 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-909ecc02-6d93-4b51-9a7c-4f4920ef3335 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:03.028277 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-909ecc02-6d93-4b51-9a7c-4f4920ef3335 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:03.040690 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-9ce79700-f962-43ff-aa50-74c02fa8ba4c tempest-TestShelveInstance-1030248060 tempest-TestShelveInstance-1030248060-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2088558392" status: 202 len: 0 microversion: 2.1 time: 0.080986 Aug 01 14:31:03.041590 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 537/1077] 10.222.0.49 () {58 vars in 1254 bytes} [Mon Aug 1 14:31:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2088558392 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:31:03.195273 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-909ecc02-6d93-4b51-9a7c-4f4920ef3335 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:03.204880 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-909ecc02-6d93-4b51-9a7c-4f4920ef3335 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1265 microversion: 2.1 time: 0.190898 Aug 01 14:31:03.208583 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 541/1078] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:03 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:31:04.229977 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3a2303de-ad0b-46fa-9adf-bf93da103c0e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:04.230716 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3a2303de-ad0b-46fa-9adf-bf93da103c0e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:04.237414 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3a2303de-ad0b-46fa-9adf-bf93da103c0e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:04.238167 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3a2303de-ad0b-46fa-9adf-bf93da103c0e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:04.241355 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3a2303de-ad0b-46fa-9adf-bf93da103c0e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:04.241355 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3a2303de-ad0b-46fa-9adf-bf93da103c0e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:04.508473 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3a2303de-ad0b-46fa-9adf-bf93da103c0e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:04.517663 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3a2303de-ad0b-46fa-9adf-bf93da103c0e tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1265 microversion: 2.1 time: 0.291646 Aug 01 14:31:04.528589 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 538/1079] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:04 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1265 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:05.539405 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0162af58-f2d6-4847-9881-f4c9aa8fbf87 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:05.539957 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0162af58-f2d6-4847-9881-f4c9aa8fbf87 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:05.546388 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0162af58-f2d6-4847-9881-f4c9aa8fbf87 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:05.551886 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0162af58-f2d6-4847-9881-f4c9aa8fbf87 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:05.551886 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0162af58-f2d6-4847-9881-f4c9aa8fbf87 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:05.551886 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0162af58-f2d6-4847-9881-f4c9aa8fbf87 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:05.891749 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0162af58-f2d6-4847-9881-f4c9aa8fbf87 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:05.895315 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:05.899853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0162af58-f2d6-4847-9881-f4c9aa8fbf87 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1265 microversion: 2.1 time: 0.364659 Aug 01 14:31:05.900420 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 542/1080] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:05 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1265 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:06.088416 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-97c16528-dfb6-4432-b1ba-43fd27c86511 req-ca542d86-c648-4459-8568-653ed81e479b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6731b91-eec1-464e-aa85-217a2a172493", "name": "network-vif-plugged", "status": "completed", "tag": "a7fb0259-103e-4ba9-b56f-00ca293e5f4d"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:31:06.095286 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=2 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:06.100908 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-97c16528-dfb6-4432-b1ba-43fd27c86511 req-ca542d86-c648-4459-8568-653ed81e479b service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:06.102081 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-97c16528-dfb6-4432-b1ba-43fd27c86511 req-ca542d86-c648-4459-8568-653ed81e479b service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:06.117329 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-97c16528-dfb6-4432-b1ba-43fd27c86511 req-ca542d86-c648-4459-8568-653ed81e479b service nova] Creating event network-vif-plugged:a7fb0259-103e-4ba9-b56f-00ca293e5f4d for instance b6731b91-eec1-464e-aa85-217a2a172493 on hv-cinder-78729 Aug 01 14:31:06.122586 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-97c16528-dfb6-4432-b1ba-43fd27c86511 req-ca542d86-c648-4459-8568-653ed81e479b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038845 Aug 01 14:31:06.123497 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 539/1081] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:31:06.923857 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-56d82cb9-368c-4570-9821-64a89c206796 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:06.924558 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-56d82cb9-368c-4570-9821-64a89c206796 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:06.932138 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-56d82cb9-368c-4570-9821-64a89c206796 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:06.933190 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-56d82cb9-368c-4570-9821-64a89c206796 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:06.934038 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-56d82cb9-368c-4570-9821-64a89c206796 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:06.934874 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-56d82cb9-368c-4570-9821-64a89c206796 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:07.084421 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-56d82cb9-368c-4570-9821-64a89c206796 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:07.093131 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-56d82cb9-368c-4570-9821-64a89c206796 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1265 microversion: 2.1 time: 0.174650 Aug 01 14:31:07.093700 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 543/1082] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:06 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:08.115873 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-96327334-8ca0-4c92-9f98-cf41d9473881 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:08.116638 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-96327334-8ca0-4c92-9f98-cf41d9473881 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:08.124467 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-96327334-8ca0-4c92-9f98-cf41d9473881 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:08.124921 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-96327334-8ca0-4c92-9f98-cf41d9473881 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:08.125692 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-96327334-8ca0-4c92-9f98-cf41d9473881 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:08.126159 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-96327334-8ca0-4c92-9f98-cf41d9473881 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:08.328419 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-96327334-8ca0-4c92-9f98-cf41d9473881 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:08.336810 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-96327334-8ca0-4c92-9f98-cf41d9473881 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1265 microversion: 2.1 time: 0.225097 Aug 01 14:31:08.337398 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 540/1083] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:08 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:09.194209 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c327e397-cd3a-47b8-8b60-5b71115bda66 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:09.195685 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c327e397-cd3a-47b8-8b60-5b71115bda66 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:09.207608 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c327e397-cd3a-47b8-8b60-5b71115bda66 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:09.208860 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c327e397-cd3a-47b8-8b60-5b71115bda66 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:09.212934 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c327e397-cd3a-47b8-8b60-5b71115bda66 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:09.214605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c327e397-cd3a-47b8-8b60-5b71115bda66 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:09.357121 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0084a25e-eb69-4913-90ae-4f3b3e1e176d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:09.357883 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0084a25e-eb69-4913-90ae-4f3b3e1e176d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:09.365538 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0084a25e-eb69-4913-90ae-4f3b3e1e176d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:09.366097 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0084a25e-eb69-4913-90ae-4f3b3e1e176d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:09.367699 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0084a25e-eb69-4913-90ae-4f3b3e1e176d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:09.368348 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0084a25e-eb69-4913-90ae-4f3b3e1e176d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:09.440300 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-c327e397-cd3a-47b8-8b60-5b71115bda66 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:09.450650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c327e397-cd3a-47b8-8b60-5b71115bda66 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1592 microversion: 2.1 time: 0.261023 Aug 01 14:31:09.454130 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 544/1084] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:09 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1592 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:09.592860 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-0084a25e-eb69-4913-90ae-4f3b3e1e176d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:09.600465 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0084a25e-eb69-4913-90ae-4f3b3e1e176d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1452 microversion: 2.1 time: 0.247815 Aug 01 14:31:09.602406 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 541/1085] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:09 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1452 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:09.626273 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-8feb9bec-c7bd-4c86-aa30-96c2e783d773 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:09.626888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-8feb9bec-c7bd-4c86-aa30-96c2e783d773 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:09.634356 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8feb9bec-c7bd-4c86-aa30-96c2e783d773 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:09.634809 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8feb9bec-c7bd-4c86-aa30-96c2e783d773 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:09.635768 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8feb9bec-c7bd-4c86-aa30-96c2e783d773 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:09.636139 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8feb9bec-c7bd-4c86-aa30-96c2e783d773 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:09.855907 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-8feb9bec-c7bd-4c86-aa30-96c2e783d773 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:09.873015 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-8feb9bec-c7bd-4c86-aa30-96c2e783d773 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1452 microversion: 2.1 time: 0.250377 Aug 01 14:31:09.874075 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 545/1086] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:09 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1452 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:12.400340 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-65279e53-5e2e-4e76-9d0a-175c6d751e11 req-5ca9ef82-9b44-4fbc-bb6f-fd733ec74c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6731b91-eec1-464e-aa85-217a2a172493", "tag": "a7fb0259-103e-4ba9-b56f-00ca293e5f4d"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:31:12.412291 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-65279e53-5e2e-4e76-9d0a-175c6d751e11 req-5ca9ef82-9b44-4fbc-bb6f-fd733ec74c44 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:12.412832 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-65279e53-5e2e-4e76-9d0a-175c6d751e11 req-5ca9ef82-9b44-4fbc-bb6f-fd733ec74c44 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:12.426949 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-65279e53-5e2e-4e76-9d0a-175c6d751e11 req-5ca9ef82-9b44-4fbc-bb6f-fd733ec74c44 service nova] Creating event network-changed:a7fb0259-103e-4ba9-b56f-00ca293e5f4d for instance b6731b91-eec1-464e-aa85-217a2a172493 on hv-cinder-78729 Aug 01 14:31:12.434243 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-65279e53-5e2e-4e76-9d0a-175c6d751e11 req-5ca9ef82-9b44-4fbc-bb6f-fd733ec74c44 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039235 Aug 01 14:31:12.439296 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 542/1087] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:31:12.841513 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-bfe2497a-a63a-456e-ac90-5163e09b8642 req-78533e9e-cf34-4a0d-adcb-ccc2cbc8b87e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f818132-d74c-4e1d-80d2-26fbc8d68325", "tag": "2d661070-4d21-4715-be5d-845fc083bf67"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:31:12.854736 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-bfe2497a-a63a-456e-ac90-5163e09b8642 req-78533e9e-cf34-4a0d-adcb-ccc2cbc8b87e service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:12.855340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-bfe2497a-a63a-456e-ac90-5163e09b8642 req-78533e9e-cf34-4a0d-adcb-ccc2cbc8b87e service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:12.875349 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-bfe2497a-a63a-456e-ac90-5163e09b8642 req-78533e9e-cf34-4a0d-adcb-ccc2cbc8b87e service nova] Creating event network-changed:2d661070-4d21-4715-be5d-845fc083bf67 for instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 on hv-cinder-78729 Aug 01 14:31:12.883368 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-bfe2497a-a63a-456e-ac90-5163e09b8642 req-78533e9e-cf34-4a0d-adcb-ccc2cbc8b87e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135889 Aug 01 14:31:12.885660 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 546/1088] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:31:16.242769 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-20ef55d0-5e24-4384-8bf1-a968c4b6fe76 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-428686936"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:31:16.243496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-20ef55d0-5e24-4384-8bf1-a968c4b6fe76 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:16.249772 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-20ef55d0-5e24-4384-8bf1-a968c4b6fe76 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:16.250239 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-20ef55d0-5e24-4384-8bf1-a968c4b6fe76 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:16.251034 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-20ef55d0-5e24-4384-8bf1-a968c4b6fe76 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:16.251469 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-20ef55d0-5e24-4384-8bf1-a968c4b6fe76 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:16.375621 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.network.security_group_api [None req-20ef55d0-5e24-4384-8bf1-a968c4b6fe76 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Adding security group eef6e302-9d1d-44b4-bdf7-78f7ca988ecc to port 2d661070-4d21-4715-be5d-845fc083bf67 Aug 01 14:31:16.808275 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-20ef55d0-5e24-4384-8bf1-a968c4b6fe76 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "POST /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/action" status: 202 len: 0 microversion: 2.1 time: 0.570906 Aug 01 14:31:16.809020 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 543/1089] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Aug 1 14:31:16 2022] POST /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:31:16.818170 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0b56b79d-a818-403f-ac32-d4cafac7000f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:16.819011 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0b56b79d-a818-403f-ac32-d4cafac7000f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:16.821083 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:16.826286 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b56b79d-a818-403f-ac32-d4cafac7000f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:16.826740 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b56b79d-a818-403f-ac32-d4cafac7000f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:16.827685 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b56b79d-a818-403f-ac32-d4cafac7000f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:16.832590 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-1eb7f91e-b87c-4ce9-bd16-b14dccb60f32 req-b4df3ebd-6d28-45dc-97b1-1e4f4f09f5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f818132-d74c-4e1d-80d2-26fbc8d68325", "tag": "2d661070-4d21-4715-be5d-845fc083bf67"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:31:16.838359 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b56b79d-a818-403f-ac32-d4cafac7000f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:16.844059 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:16.860866 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-1eb7f91e-b87c-4ce9-bd16-b14dccb60f32 req-b4df3ebd-6d28-45dc-97b1-1e4f4f09f5d8 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:16.861322 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-1eb7f91e-b87c-4ce9-bd16-b14dccb60f32 req-b4df3ebd-6d28-45dc-97b1-1e4f4f09f5d8 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:16.881118 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-1eb7f91e-b87c-4ce9-bd16-b14dccb60f32 req-b4df3ebd-6d28-45dc-97b1-1e4f4f09f5d8 service nova] Creating event network-changed:2d661070-4d21-4715-be5d-845fc083bf67 for instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 on hv-cinder-78729 Aug 01 14:31:16.886431 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-1eb7f91e-b87c-4ce9-bd16-b14dccb60f32 req-b4df3ebd-6d28-45dc-97b1-1e4f4f09f5d8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057482 Aug 01 14:31:16.887114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 544/1090] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:31:17.019170 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0b56b79d-a818-403f-ac32-d4cafac7000f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:17.028053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0b56b79d-a818-403f-ac32-d4cafac7000f tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1756 microversion: 2.1 time: 0.214682 Aug 01 14:31:17.028626 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 547/1091] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:16 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1756 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:31:26.107076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:31:26.107740 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Mon Aug 1 14:31:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:31:39.723201 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=32 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:39.727928 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0c40146c-985a-493d-aa3e-b5b619655744 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:31:39.730283 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0c40146c-985a-493d-aa3e-b5b619655744 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:39.737184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0c40146c-985a-493d-aa3e-b5b619655744 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:39.739105 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0c40146c-985a-493d-aa3e-b5b619655744 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:39.739105 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0c40146c-985a-493d-aa3e-b5b619655744 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:39.739340 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0c40146c-985a-493d-aa3e-b5b619655744 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:39.949899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0c40146c-985a-493d-aa3e-b5b619655744 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "POST /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/action" status: 202 len: 0 microversion: 2.1 time: 0.228435 Aug 01 14:31:39.950595 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 545/1092] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Aug 1 14:31:39 2022] POST /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:31:39.959217 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-11be151a-96a5-4f66-8048-9db2022c9253 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:39.959835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-11be151a-96a5-4f66-8048-9db2022c9253 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:39.962318 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=26 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:39.968401 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-11be151a-96a5-4f66-8048-9db2022c9253 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:39.968856 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-11be151a-96a5-4f66-8048-9db2022c9253 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:39.969623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-11be151a-96a5-4f66-8048-9db2022c9253 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:39.970102 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-11be151a-96a5-4f66-8048-9db2022c9253 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:40.116858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-11be151a-96a5-4f66-8048-9db2022c9253 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:40.125813 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-11be151a-96a5-4f66-8048-9db2022c9253 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1748 microversion: 2.1 time: 0.170857 Aug 01 14:31:40.126382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 548/1093] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:39 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1748 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:41.149474 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-544c3c81-c8ea-4c2d-897f-ef28dcf0c2ed tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:41.150214 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-544c3c81-c8ea-4c2d-897f-ef28dcf0c2ed tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:41.157052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-544c3c81-c8ea-4c2d-897f-ef28dcf0c2ed tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:41.161524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-544c3c81-c8ea-4c2d-897f-ef28dcf0c2ed tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:41.161524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-544c3c81-c8ea-4c2d-897f-ef28dcf0c2ed tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:41.161524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-544c3c81-c8ea-4c2d-897f-ef28dcf0c2ed tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:41.307903 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-544c3c81-c8ea-4c2d-897f-ef28dcf0c2ed tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:41.316714 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-544c3c81-c8ea-4c2d-897f-ef28dcf0c2ed tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1753 microversion: 2.1 time: 0.171929 Aug 01 14:31:41.317288 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 546/1094] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:41 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:42.339001 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a1b559c4-c2c8-4e73-9563-d6e9221edaf2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:42.339613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a1b559c4-c2c8-4e73-9563-d6e9221edaf2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:42.347259 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a1b559c4-c2c8-4e73-9563-d6e9221edaf2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:42.347783 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a1b559c4-c2c8-4e73-9563-d6e9221edaf2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:42.348551 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a1b559c4-c2c8-4e73-9563-d6e9221edaf2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:42.348988 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a1b559c4-c2c8-4e73-9563-d6e9221edaf2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:42.494960 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a1b559c4-c2c8-4e73-9563-d6e9221edaf2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:42.502968 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a1b559c4-c2c8-4e73-9563-d6e9221edaf2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1753 microversion: 2.1 time: 0.167922 Aug 01 14:31:42.503525 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 549/1095] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:42 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:43.524737 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-a7d29078-bef5-4799-bb27-1bc16c3ec99a tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:43.525407 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-a7d29078-bef5-4799-bb27-1bc16c3ec99a tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:43.532813 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a7d29078-bef5-4799-bb27-1bc16c3ec99a tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:43.533257 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a7d29078-bef5-4799-bb27-1bc16c3ec99a tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:43.534120 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a7d29078-bef5-4799-bb27-1bc16c3ec99a tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:43.534550 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a7d29078-bef5-4799-bb27-1bc16c3ec99a tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:43.677374 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a7d29078-bef5-4799-bb27-1bc16c3ec99a tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:43.685410 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-a7d29078-bef5-4799-bb27-1bc16c3ec99a tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1753 microversion: 2.1 time: 0.164538 Aug 01 14:31:43.689403 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 547/1096] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:43 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:44.706863 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f23350be-d4cc-4faf-8d23-ab2dae928b1e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:44.707469 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f23350be-d4cc-4faf-8d23-ab2dae928b1e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:44.714029 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f23350be-d4cc-4faf-8d23-ab2dae928b1e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:44.714480 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f23350be-d4cc-4faf-8d23-ab2dae928b1e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:44.715240 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f23350be-d4cc-4faf-8d23-ab2dae928b1e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:44.715677 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f23350be-d4cc-4faf-8d23-ab2dae928b1e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:44.857690 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f23350be-d4cc-4faf-8d23-ab2dae928b1e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:44.866615 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f23350be-d4cc-4faf-8d23-ab2dae928b1e tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1753 microversion: 2.1 time: 0.163929 Aug 01 14:31:44.867181 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 550/1097] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:44 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:45.732622 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d35c97f4-6cde-4252-853d-a6c4c7398daa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:45.733291 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d35c97f4-6cde-4252-853d-a6c4c7398daa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:45.740133 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d35c97f4-6cde-4252-853d-a6c4c7398daa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:45.740577 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d35c97f4-6cde-4252-853d-a6c4c7398daa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:45.741330 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d35c97f4-6cde-4252-853d-a6c4c7398daa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:45.741783 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d35c97f4-6cde-4252-853d-a6c4c7398daa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:45.765581 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d35c97f4-6cde-4252-853d-a6c4c7398daa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/ips" status: 200 len: 148 microversion: 2.1 time: 0.035957 Aug 01 14:31:45.766188 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 548/1098] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Aug 1 14:31:45 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:31:45.888613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-21f61d2e-f0f6-4e1a-be8b-4b5cc1c30abc tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:45.889221 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-21f61d2e-f0f6-4e1a-be8b-4b5cc1c30abc tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:45.896365 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-21f61d2e-f0f6-4e1a-be8b-4b5cc1c30abc tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:45.896812 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-21f61d2e-f0f6-4e1a-be8b-4b5cc1c30abc tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:45.897579 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-21f61d2e-f0f6-4e1a-be8b-4b5cc1c30abc tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:45.898047 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-21f61d2e-f0f6-4e1a-be8b-4b5cc1c30abc tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:46.040830 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-21f61d2e-f0f6-4e1a-be8b-4b5cc1c30abc tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:46.049195 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-21f61d2e-f0f6-4e1a-be8b-4b5cc1c30abc tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1753 microversion: 2.1 time: 0.164388 Aug 01 14:31:46.049761 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 551/1099] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:45 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:47.070773 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5696a4f2-a548-4d0c-99ec-94173b15a80d tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:47.071345 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5696a4f2-a548-4d0c-99ec-94173b15a80d tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:47.077671 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5696a4f2-a548-4d0c-99ec-94173b15a80d tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:47.081245 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5696a4f2-a548-4d0c-99ec-94173b15a80d tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:47.081245 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5696a4f2-a548-4d0c-99ec-94173b15a80d tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:47.081245 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5696a4f2-a548-4d0c-99ec-94173b15a80d tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:47.224211 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-5696a4f2-a548-4d0c-99ec-94173b15a80d tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:47.232070 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5696a4f2-a548-4d0c-99ec-94173b15a80d tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1753 microversion: 2.1 time: 0.165251 Aug 01 14:31:47.232611 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 549/1100] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:47 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:47.447730 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-2f2c6953-b706-48bb-bb26-2a4797e3d50c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "421b93c6-dfba-428b-8286-66bfb15ca48f"}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:31:47.450108 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-2f2c6953-b706-48bb-bb26-2a4797e3d50c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:47.456628 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2f2c6953-b706-48bb-bb26-2a4797e3d50c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:47.457071 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2f2c6953-b706-48bb-bb26-2a4797e3d50c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:47.457857 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2f2c6953-b706-48bb-bb26-2a4797e3d50c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:47.458297 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-2f2c6953-b706-48bb-bb26-2a4797e3d50c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:48.254259 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-20f38149-a5b4-4da1-b2fd-f697beafda14 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:48.254896 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-20f38149-a5b4-4da1-b2fd-f697beafda14 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:48.261272 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-20f38149-a5b4-4da1-b2fd-f697beafda14 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:48.261715 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-20f38149-a5b4-4da1-b2fd-f697beafda14 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:48.262494 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-20f38149-a5b4-4da1-b2fd-f697beafda14 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:48.262925 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-20f38149-a5b4-4da1-b2fd-f697beafda14 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:48.407244 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-2f2c6953-b706-48bb-bb26-2a4797e3d50c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "POST /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.963172 Aug 01 14:31:48.412315 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 552/1101] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Aug 1 14:31:47 2022] POST /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/os-volume_attachments => generated 194 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:31:48.412442 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-20f38149-a5b4-4da1-b2fd-f697beafda14 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:48.419618 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-20f38149-a5b4-4da1-b2fd-f697beafda14 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1753 microversion: 2.1 time: 0.169501 Aug 01 14:31:48.420520 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 550/1102] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:48 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:31:49.441457 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-eca7cc6d-15f5-45bb-810e-b4e1089eb04b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:49.442221 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-eca7cc6d-15f5-45bb-810e-b4e1089eb04b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:49.448448 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-eca7cc6d-15f5-45bb-810e-b4e1089eb04b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:49.448905 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-eca7cc6d-15f5-45bb-810e-b4e1089eb04b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:49.449673 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-eca7cc6d-15f5-45bb-810e-b4e1089eb04b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:49.450141 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-eca7cc6d-15f5-45bb-810e-b4e1089eb04b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:49.595498 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-eca7cc6d-15f5-45bb-810e-b4e1089eb04b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:49.604594 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-eca7cc6d-15f5-45bb-810e-b4e1089eb04b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1753 microversion: 2.1 time: 0.167747 Aug 01 14:31:49.605147 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 553/1103] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:49 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:50.626465 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f2afd6fe-6a5b-4b50-96d0-e87a8881fb45 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:50.627072 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f2afd6fe-6a5b-4b50-96d0-e87a8881fb45 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:50.633632 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2afd6fe-6a5b-4b50-96d0-e87a8881fb45 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:50.634115 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2afd6fe-6a5b-4b50-96d0-e87a8881fb45 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:50.634879 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2afd6fe-6a5b-4b50-96d0-e87a8881fb45 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:50.635320 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2afd6fe-6a5b-4b50-96d0-e87a8881fb45 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:50.777614 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f2afd6fe-6a5b-4b50-96d0-e87a8881fb45 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:50.786638 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f2afd6fe-6a5b-4b50-96d0-e87a8881fb45 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1753 microversion: 2.1 time: 0.164174 Aug 01 14:31:50.787153 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 551/1104] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:50 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:51.808246 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-048acb2a-6810-4682-bb3d-80a214a11a96 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:51.808858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-048acb2a-6810-4682-bb3d-80a214a11a96 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:51.816364 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-048acb2a-6810-4682-bb3d-80a214a11a96 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:51.816813 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-048acb2a-6810-4682-bb3d-80a214a11a96 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:51.817573 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-048acb2a-6810-4682-bb3d-80a214a11a96 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:51.818043 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-048acb2a-6810-4682-bb3d-80a214a11a96 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:51.962158 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-048acb2a-6810-4682-bb3d-80a214a11a96 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:51.970222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-048acb2a-6810-4682-bb3d-80a214a11a96 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1753 microversion: 2.1 time: 0.165848 Aug 01 14:31:51.973686 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 554/1105] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:51 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:52.991731 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f2c05d03-eed3-46d2-a67c-365c98d73437 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:52.992299 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f2c05d03-eed3-46d2-a67c-365c98d73437 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:52.998799 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2c05d03-eed3-46d2-a67c-365c98d73437 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:52.999253 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2c05d03-eed3-46d2-a67c-365c98d73437 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:53.000013 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2c05d03-eed3-46d2-a67c-365c98d73437 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:53.000968 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f2c05d03-eed3-46d2-a67c-365c98d73437 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:53.143648 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f2c05d03-eed3-46d2-a67c-365c98d73437 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:53.151550 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f2c05d03-eed3-46d2-a67c-365c98d73437 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1756 microversion: 2.1 time: 0.164044 Aug 01 14:31:53.152122 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 552/1106] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:52 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:31:55.933185 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7c943913-0103-4079-a027-103249797e55 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "421b93c6-dfba-428b-8286-66bfb15ca48f"}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:31:55.935679 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7c943913-0103-4079-a027-103249797e55 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:55.943261 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7c943913-0103-4079-a027-103249797e55 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:55.944525 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7c943913-0103-4079-a027-103249797e55 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:55.944525 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7c943913-0103-4079-a027-103249797e55 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:55.945094 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7c943913-0103-4079-a027-103249797e55 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:56.025375 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-7c943913-0103-4079-a027-103249797e55 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] HTTP exception thrown: Invalid volume: volume 421b93c6-dfba-428b-8286-66bfb15ca48f is already attached to instances: be92eb56-b7dd-481d-85ea-83ac3617db42 Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7c943913-0103-4079-a027-103249797e55 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Request method failure captured: Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: POST /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/os-volume_attachments HTTP/1.1 Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 74 Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-L0M5WO8nDE0q1CG-Np5H3kIUpdYJfyjx92RxgagSas2PQX4zcSsYAcbMGYJoVR82J_bQyPwI-P3t2LR46Kh_WLn_u4I3f3WhblPY-X4bycK9lCMByrTu1qFbUY82UF9aEod0Q_XtMLge0BwV8zmcLvEk0eUJbXm4ubmcvI5bVAbbs Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:31:56.027133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:31:56.028881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:31:56.028881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:31:56.028881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:31:56.028881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:31:56.028881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:31:56.028881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:31:56.028881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:31:56.028881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: fbb29845a13844f89fd004b401d27b8e Aug 01 14:31:56.028881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:31:56.028881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Aug 01 14:31:56.028881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {"volumeAttachment": {"volumeId": "421b93c6-dfba-428b-8286-66bfb15ca48f"}} Aug 01 14:31:56.028881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Invalid volume: volume 421b93c6-dfba-428b-8286-66bfb15ca48f is already attached to instances: be92eb56-b7dd-481d-85ea-83ac3617db42 Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'server_id': 'be92eb56-b7dd-481d-85ea-83ac3617db42', 'body': {'volumeAttachment': {'volumeId': '421b93c6-dfba-428b-8286-66bfb15ca48f'}}} Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 421b93c6-dfba-428b-8286-66bfb15ca48f is already attached to instances: be92eb56-b7dd-481d-85ea-83ac3617db42 Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:31:56.029906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 421b93c6-dfba-428b-8286-66bfb15ca48f is already attached to instances: be92eb56-b7dd-481d-85ea-83ac3617db42 Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:31:56.031472 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:31:56.033888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:31:56.033888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:31:56.033888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:31:56.033888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 421b93c6-dfba-428b-8286-66bfb15ca48f is already attached to instances: be92eb56-b7dd-481d-85ea-83ac3617db42 Aug 01 14:31:56.033888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:31:56.033888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7c943913-0103-4079-a027-103249797e55 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Returning 400 to user: Invalid volume: volume 421b93c6-dfba-428b-8286-66bfb15ca48f is already attached to instances: be92eb56-b7dd-481d-85ea-83ac3617db42 {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:31:56.033888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7c943913-0103-4079-a027-103249797e55 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "POST /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100367 Aug 01 14:31:56.033888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 555/1107] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Aug 1 14:31:55 2022] POST /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:31:56.095723 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-86364d35-e603-43d8-9630-d55dd23f7761 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:56.099872 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-86364d35-e603-43d8-9630-d55dd23f7761 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:56.103536 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-86364d35-e603-43d8-9630-d55dd23f7761 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:56.103984 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-86364d35-e603-43d8-9630-d55dd23f7761 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:56.104747 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-86364d35-e603-43d8-9630-d55dd23f7761 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:56.105310 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-86364d35-e603-43d8-9630-d55dd23f7761 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:56.185761 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-86364d35-e603-43d8-9630-d55dd23f7761 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lazy-loading 'services' on Instance uuid be92eb56-b7dd-481d-85ea-83ac3617db42 {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:31:56.372259 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-86364d35-e603-43d8-9630-d55dd23f7761 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "DELETE /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/os-volume_attachments/421b93c6-dfba-428b-8286-66bfb15ca48f" status: 202 len: 0 microversion: 2.1 time: 0.281347 Aug 01 14:31:56.372936 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 553/1108] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Aug 1 14:31:56 2022] DELETE /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/os-volume_attachments/421b93c6-dfba-428b-8286-66bfb15ca48f => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:31:56.382681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6eac6589-a270-4502-8ea9-c270cf3a37cc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:56.384935 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-6eac6589-a270-4502-8ea9-c270cf3a37cc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:56.391793 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6eac6589-a270-4502-8ea9-c270cf3a37cc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:56.393453 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6eac6589-a270-4502-8ea9-c270cf3a37cc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:56.394266 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6eac6589-a270-4502-8ea9-c270cf3a37cc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:56.394704 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6eac6589-a270-4502-8ea9-c270cf3a37cc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:56.423363 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-6eac6589-a270-4502-8ea9-c270cf3a37cc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044581 Aug 01 14:31:56.426393 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 556/1109] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:31:56 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:31:57.436263 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-01e78cc9-37d7-4bf5-8053-35471e8bb827 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:57.438903 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-01e78cc9-37d7-4bf5-8053-35471e8bb827 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:57.445437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-01e78cc9-37d7-4bf5-8053-35471e8bb827 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:57.453803 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-01e78cc9-37d7-4bf5-8053-35471e8bb827 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:57.453803 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-01e78cc9-37d7-4bf5-8053-35471e8bb827 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:57.453803 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-01e78cc9-37d7-4bf5-8053-35471e8bb827 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:57.478608 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-01e78cc9-37d7-4bf5-8053-35471e8bb827 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047272 Aug 01 14:31:57.479166 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 554/1110] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:31:57 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:31:58.491213 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-788b82dd-f67e-4612-89c5-06d324b18e12 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:58.493328 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-788b82dd-f67e-4612-89c5-06d324b18e12 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:58.499822 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-788b82dd-f67e-4612-89c5-06d324b18e12 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:58.500279 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-788b82dd-f67e-4612-89c5-06d324b18e12 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:58.501052 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-788b82dd-f67e-4612-89c5-06d324b18e12 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:58.502220 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-788b82dd-f67e-4612-89c5-06d324b18e12 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:58.530567 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-788b82dd-f67e-4612-89c5-06d324b18e12 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043670 Aug 01 14:31:58.531113 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 557/1111] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:31:58 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:31:58.591154 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-631791e4-fcb1-437f-b9b5-3f6d9915da0d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:58.591644 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-631791e4-fcb1-437f-b9b5-3f6d9915da0d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:58.597734 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-631791e4-fcb1-437f-b9b5-3f6d9915da0d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:58.598220 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-631791e4-fcb1-437f-b9b5-3f6d9915da0d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:58.598985 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-631791e4-fcb1-437f-b9b5-3f6d9915da0d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:58.599424 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-631791e4-fcb1-437f-b9b5-3f6d9915da0d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:58.623478 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-631791e4-fcb1-437f-b9b5-3f6d9915da0d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Going to try to terminate instance {{(pid=118246) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:31:58.924230 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-631791e4-fcb1-437f-b9b5-3f6d9915da0d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "DELETE /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 204 len: 0 microversion: 2.1 time: 0.335711 Aug 01 14:31:58.924822 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 555/1112] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:31:58 2022] DELETE /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:31:58.932826 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-de1a72e1-2a09-48ad-8a2d-b8a4eee0a162 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:31:58.935114 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-de1a72e1-2a09-48ad-8a2d-b8a4eee0a162 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:31:58.941074 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-de1a72e1-2a09-48ad-8a2d-b8a4eee0a162 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:58.941526 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-de1a72e1-2a09-48ad-8a2d-b8a4eee0a162 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:58.942343 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-de1a72e1-2a09-48ad-8a2d-b8a4eee0a162 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:31:58.942782 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-de1a72e1-2a09-48ad-8a2d-b8a4eee0a162 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:31:59.072523 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-de1a72e1-2a09-48ad-8a2d-b8a4eee0a162 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:31:59.081193 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-de1a72e1-2a09-48ad-8a2d-b8a4eee0a162 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1680 microversion: 2.1 time: 0.152167 Aug 01 14:31:59.081777 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 558/1113] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:31:58 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:32:00.104792 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0414e402-8c22-4c2c-8295-8d8be08eec9e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:00.105486 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0414e402-8c22-4c2c-8295-8d8be08eec9e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:00.113353 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0414e402-8c22-4c2c-8295-8d8be08eec9e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:00.113820 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0414e402-8c22-4c2c-8295-8d8be08eec9e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:00.114615 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0414e402-8c22-4c2c-8295-8d8be08eec9e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:00.115054 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0414e402-8c22-4c2c-8295-8d8be08eec9e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:00.246600 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-0414e402-8c22-4c2c-8295-8d8be08eec9e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:00.255093 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0414e402-8c22-4c2c-8295-8d8be08eec9e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1680 microversion: 2.1 time: 0.154560 Aug 01 14:32:00.255651 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 556/1114] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:00 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:01.276465 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-cc4bf8a8-6813-4eca-a112-2b9e60a858f6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:01.277192 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-cc4bf8a8-6813-4eca-a112-2b9e60a858f6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:01.283954 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cc4bf8a8-6813-4eca-a112-2b9e60a858f6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:01.284407 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cc4bf8a8-6813-4eca-a112-2b9e60a858f6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:01.285423 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cc4bf8a8-6813-4eca-a112-2b9e60a858f6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:01.285807 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cc4bf8a8-6813-4eca-a112-2b9e60a858f6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:01.417823 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-cc4bf8a8-6813-4eca-a112-2b9e60a858f6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:01.426036 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-cc4bf8a8-6813-4eca-a112-2b9e60a858f6 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1680 microversion: 2.1 time: 0.153384 Aug 01 14:32:01.426842 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 559/1115] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:01 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:01.715755 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-c6b5a52c-788c-4f28-9892-17da17834474 req-0d24efb5-0d9a-4c23-91ca-ec569735cb0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be92eb56-b7dd-481d-85ea-83ac3617db42", "name": "network-vif-deleted", "tag": "8a784b0b-c5b0-4587-87f1-06d2000c3317"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:01.726089 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-c6b5a52c-788c-4f28-9892-17da17834474 req-0d24efb5-0d9a-4c23-91ca-ec569735cb0a service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:01.726536 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-c6b5a52c-788c-4f28-9892-17da17834474 req-0d24efb5-0d9a-4c23-91ca-ec569735cb0a service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:01.737967 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-c6b5a52c-788c-4f28-9892-17da17834474 req-0d24efb5-0d9a-4c23-91ca-ec569735cb0a service nova] Creating event network-vif-deleted:8a784b0b-c5b0-4587-87f1-06d2000c3317 for instance be92eb56-b7dd-481d-85ea-83ac3617db42 on hv-cinder-78729 Aug 01 14:32:01.742895 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-c6b5a52c-788c-4f28-9892-17da17834474 req-0d24efb5-0d9a-4c23-91ca-ec569735cb0a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030766 Aug 01 14:32:01.743691 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 557/1116] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:32:02.448102 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-fa8f427a-9eda-4854-aced-89463916c4bf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:02.448752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-fa8f427a-9eda-4854-aced-89463916c4bf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:02.456736 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fa8f427a-9eda-4854-aced-89463916c4bf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:02.456914 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fa8f427a-9eda-4854-aced-89463916c4bf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:02.457682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fa8f427a-9eda-4854-aced-89463916c4bf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:02.458142 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fa8f427a-9eda-4854-aced-89463916c4bf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:02.491980 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fa8f427a-9eda-4854-aced-89463916c4bf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:02.492537 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-fa8f427a-9eda-4854-aced-89463916c4bf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:02.492886 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-fa8f427a-9eda-4854-aced-89463916c4bf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lazy-loading 'fault' on Instance uuid be92eb56-b7dd-481d-85ea-83ac3617db42 {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:32:02.535268 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-fa8f427a-9eda-4854-aced-89463916c4bf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:02.542977 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-fa8f427a-9eda-4854-aced-89463916c4bf tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 200 len: 1331 microversion: 2.1 time: 0.098747 Aug 01 14:32:02.543604 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 560/1117] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:02 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:03.564827 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-80a3fd18-af2e-4c01-96fd-ee4f2b71860d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:03.565558 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-80a3fd18-af2e-4c01-96fd-ee4f2b71860d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:03.572269 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-80a3fd18-af2e-4c01-96fd-ee4f2b71860d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:03.572724 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-80a3fd18-af2e-4c01-96fd-ee4f2b71860d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:03.573492 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-80a3fd18-af2e-4c01-96fd-ee4f2b71860d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:03.573974 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-80a3fd18-af2e-4c01-96fd-ee4f2b71860d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:03.587401 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-80a3fd18-af2e-4c01-96fd-ee4f2b71860d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] HTTP exception thrown: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-80a3fd18-af2e-4c01-96fd-ee4f2b71860d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Request method failure captured: Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 HTTP/1.1 Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-L0M5WO8nDE0q1CG-Np5H3kIUpdYJfyjx92RxgagSas2PQX4zcSsYAcbMGYJoVR82J_bQyPwI-P3t2LR46Kh_WLn_u4I3f3WhblPY-X4bycK9lCMByrTu1qFbUY82UF9aEod0Q_XtMLge0BwV8zmcLvEk0eUJbXm4ubmcvI5bVAbbs Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:32:03.589006 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:32:03.590681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:32:03.590681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:32:03.590681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:32:03.590681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:32:03.590681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:32:03.590681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:32:03.590681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:32:03.590681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: fbb29845a13844f89fd004b401d27b8e Aug 01 14:32:03.590681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:32:03.590681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:32:03.590681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. Aug 01 14:32:03.590681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': 'be92eb56-b7dd-481d-85ea-83ac3617db42'} Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:32:03.591686 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. Aug 01 14:32:03.593210 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:32:03.594622 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-80a3fd18-af2e-4c01-96fd-ee4f2b71860d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Returning 404 to user: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:32:03.594622 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-80a3fd18-af2e-4c01-96fd-ee4f2b71860d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 404 len: 111 microversion: 2.1 time: 0.029864 Aug 01 14:32:03.594622 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 558/1118] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:03 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:32:03.599928 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-50425859-6632-4f06-b5bc-381b8b8476af tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '.version_select at 0x7fb24f7cca60>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:03.683966 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-50425859-6632-4f06-b5bc-381b8b8476af tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1089458345" status: 202 len: 0 microversion: 2.1 time: 0.087918 Aug 01 14:32:03.684633 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 561/1119] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Aug 1 14:32:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1089458345 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:32:04.489165 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4d7bc2ea-4b99-49af-904e-f0649e184ee2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Action: 'create', calling method: .version_select at 0x7fb2540e3af0>, body: {"keypair": {"name": "tempest-keypair-492819403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOJ0S2sejr6LYag7h5ezA1zQbUOdvBPz77TyjeAfTyKd67JkfFDR48cTBCaqeQK7zQqRZ+y2+oKkisClrmxjEL/OkEB3CaYHgs8UibSu3oInJ2m7rkI+oWuWP29u9tMGg=="}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:04.504976 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-4d7bc2ea-4b99-49af-904e-f0649e184ee2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Getting quotas for project c6df4baf0a1242f2b73fe99071682355. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:32:04.508658 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.quota [None req-4d7bc2ea-4b99-49af-904e-f0649e184ee2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Getting quotas for user fbb29845a13844f89fd004b401d27b8e and project c6df4baf0a1242f2b73fe99071682355. Resources: {'key_pairs'} {{(pid=118246) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:32:04.585378 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4d7bc2ea-4b99-49af-904e-f0649e184ee2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.100755 Aug 01 14:32:04.586053 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 559/1120] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Aug 1 14:32:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:32:06.812072 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-8dedb6df-4445-4482-9b52-3dac0b2b68d2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-343599084", "imageRef": "a4b41d5d-1236-41a9-95cd-10d735fc65ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34cc3867-be64-4b6c-a790-8e0e66fb7fc3"}], "security_groups": [{"name": "tempest-securitygroup--1361659893"}], "key_name": "tempest-keypair-492819403", "user_data": "}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:06.916540 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.network.neutron [None req-8dedb6df-4445-4482-9b52-3dac0b2b68d2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] validate_networks() for [('34cc3867-be64-4b6c-a790-8e0e66fb7fc3', None, None, None, None, None)] {{(pid=118247) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:32:07.285618 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-8dedb6df-4445-4482-9b52-3dac0b2b68d2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Flavor limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:32:07.286100 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-8dedb6df-4445-4482-9b52-3dac0b2b68d2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Image limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:32:07.286586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-8dedb6df-4445-4482-9b52-3dac0b2b68d2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Flavor pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:32:07.287003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-8dedb6df-4445-4482-9b52-3dac0b2b68d2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Image pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:32:07.287426 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-8dedb6df-4445-4482-9b52-3dac0b2b68d2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:32:07.296160 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8dedb6df-4445-4482-9b52-3dac0b2b68d2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:07.296612 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8dedb6df-4445-4482-9b52-3dac0b2b68d2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:07.297417 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8dedb6df-4445-4482-9b52-3dac0b2b68d2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:07.297954 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8dedb6df-4445-4482-9b52-3dac0b2b68d2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:07.314370 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-8dedb6df-4445-4482-9b52-3dac0b2b68d2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Getting quotas for project c6df4baf0a1242f2b73fe99071682355. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:32:07.318320 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-8dedb6df-4445-4482-9b52-3dac0b2b68d2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Getting quotas for user fbb29845a13844f89fd004b401d27b8e and project c6df4baf0a1242f2b73fe99071682355. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:32:07.329894 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-8dedb6df-4445-4482-9b52-3dac0b2b68d2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Going to run 1 instances... {{(pid=118247) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:32:07.332125 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-8dedb6df-4445-4482-9b52-3dac0b2b68d2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4b41d5d-1236-41a9-95cd-10d735fc65ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118247) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:32:07.525031 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-8dedb6df-4445-4482-9b52-3dac0b2b68d2 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.717686 Aug 01 14:32:07.525668 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 562/1121] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:32:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:32:07.537454 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-8a30690f-217a-4286-8136-2ccea10ed551 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:07.538083 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-8a30690f-217a-4286-8136-2ccea10ed551 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:07.597876 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-8a30690f-217a-4286-8136-2ccea10ed551 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:07.604577 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-8a30690f-217a-4286-8136-2ccea10ed551 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 200 len: 1240 microversion: 2.1 time: 0.071679 Aug 01 14:32:07.605132 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 560/1122] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:07 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:08.625136 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-f08ea8bb-cb65-4c48-af4e-fd13587e3117 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:08.625795 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-f08ea8bb-cb65-4c48-af4e-fd13587e3117 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:08.633269 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f08ea8bb-cb65-4c48-af4e-fd13587e3117 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:08.633723 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f08ea8bb-cb65-4c48-af4e-fd13587e3117 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:08.634619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f08ea8bb-cb65-4c48-af4e-fd13587e3117 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:08.635070 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-f08ea8bb-cb65-4c48-af4e-fd13587e3117 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:08.695646 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-f08ea8bb-cb65-4c48-af4e-fd13587e3117 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:08.703294 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-f08ea8bb-cb65-4c48-af4e-fd13587e3117 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 200 len: 1244 microversion: 2.1 time: 0.082701 Aug 01 14:32:08.703888 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 563/1123] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:08 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:09.724741 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-91de4e50-5884-4d05-ad3c-92fdaa1fcc25 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:09.725364 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-91de4e50-5884-4d05-ad3c-92fdaa1fcc25 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:09.732032 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-91de4e50-5884-4d05-ad3c-92fdaa1fcc25 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:09.732485 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-91de4e50-5884-4d05-ad3c-92fdaa1fcc25 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:09.733256 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-91de4e50-5884-4d05-ad3c-92fdaa1fcc25 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:09.733694 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-91de4e50-5884-4d05-ad3c-92fdaa1fcc25 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:09.798848 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-91de4e50-5884-4d05-ad3c-92fdaa1fcc25 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:09.801582 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:09.807929 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-91de4e50-5884-4d05-ad3c-92fdaa1fcc25 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 200 len: 1300 microversion: 2.1 time: 0.087742 Aug 01 14:32:09.810172 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 561/1124] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:09 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:10.829796 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1a20b40b-1cbb-4a7a-96be-31069867b9a0 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:10.830414 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1a20b40b-1cbb-4a7a-96be-31069867b9a0 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:10.834327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:10.839185 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1a20b40b-1cbb-4a7a-96be-31069867b9a0 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:10.839639 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1a20b40b-1cbb-4a7a-96be-31069867b9a0 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:10.840630 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1a20b40b-1cbb-4a7a-96be-31069867b9a0 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:10.841076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1a20b40b-1cbb-4a7a-96be-31069867b9a0 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:10.845381 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:10.978841 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1a20b40b-1cbb-4a7a-96be-31069867b9a0 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:10.987624 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1a20b40b-1cbb-4a7a-96be-31069867b9a0 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 200 len: 1366 microversion: 2.1 time: 0.161370 Aug 01 14:32:10.988311 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 564/1125] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:10 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:32:11.472524 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-4c97f096-d8b9-491a-b87b-36f721224a21 req-8699607d-51f9-4f4a-97da-0c8ab206e5dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852e5cfc-24b4-460f-ae55-36324df2b28f", "tag": "a89af0fa-47f7-4b80-9d56-7676b463a893"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:11.479368 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:11.485084 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-4c97f096-d8b9-491a-b87b-36f721224a21 req-8699607d-51f9-4f4a-97da-0c8ab206e5dd service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:11.485773 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-4c97f096-d8b9-491a-b87b-36f721224a21 req-8699607d-51f9-4f4a-97da-0c8ab206e5dd service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:11.496962 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-4c97f096-d8b9-491a-b87b-36f721224a21 req-8699607d-51f9-4f4a-97da-0c8ab206e5dd service nova] Creating event network-changed:a89af0fa-47f7-4b80-9d56-7676b463a893 for instance 852e5cfc-24b4-460f-ae55-36324df2b28f on hv-cinder-78729 Aug 01 14:32:11.501849 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-4c97f096-d8b9-491a-b87b-36f721224a21 req-8699607d-51f9-4f4a-97da-0c8ab206e5dd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033083 Aug 01 14:32:11.502508 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 562/1126] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:32:12.010135 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-7739d6cb-bd59-4a5f-88a0-9bcd6ff4229b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:12.011260 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-7739d6cb-bd59-4a5f-88a0-9bcd6ff4229b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:12.019913 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7739d6cb-bd59-4a5f-88a0-9bcd6ff4229b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:12.020301 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7739d6cb-bd59-4a5f-88a0-9bcd6ff4229b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:12.021090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7739d6cb-bd59-4a5f-88a0-9bcd6ff4229b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:12.021529 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-7739d6cb-bd59-4a5f-88a0-9bcd6ff4229b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:12.164130 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-7739d6cb-bd59-4a5f-88a0-9bcd6ff4229b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:12.171987 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-7739d6cb-bd59-4a5f-88a0-9bcd6ff4229b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 200 len: 1366 microversion: 2.1 time: 0.166374 Aug 01 14:32:12.172540 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 565/1127] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:12 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:13.194899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-a050c59f-6584-4924-a04d-303ee24a3469 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:13.195615 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-a050c59f-6584-4924-a04d-303ee24a3469 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:13.203546 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a050c59f-6584-4924-a04d-303ee24a3469 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:13.204000 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a050c59f-6584-4924-a04d-303ee24a3469 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:13.204775 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a050c59f-6584-4924-a04d-303ee24a3469 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:13.205211 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a050c59f-6584-4924-a04d-303ee24a3469 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:13.344069 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a050c59f-6584-4924-a04d-303ee24a3469 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:13.352136 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-a050c59f-6584-4924-a04d-303ee24a3469 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 200 len: 1366 microversion: 2.1 time: 0.162790 Aug 01 14:32:13.352706 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 563/1128] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:13 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:14.373006 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-cc7a6de9-c440-4908-8ed9-6ee93b03f5ff tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:14.374137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-cc7a6de9-c440-4908-8ed9-6ee93b03f5ff tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:14.381312 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cc7a6de9-c440-4908-8ed9-6ee93b03f5ff tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:14.381781 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cc7a6de9-c440-4908-8ed9-6ee93b03f5ff tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:14.382563 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cc7a6de9-c440-4908-8ed9-6ee93b03f5ff tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:14.382999 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cc7a6de9-c440-4908-8ed9-6ee93b03f5ff tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:14.518225 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-cc7a6de9-c440-4908-8ed9-6ee93b03f5ff tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:14.526358 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-cc7a6de9-c440-4908-8ed9-6ee93b03f5ff tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 200 len: 1366 microversion: 2.1 time: 0.157189 Aug 01 14:32:14.526920 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 566/1129] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:14 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:15.546709 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-2fe6a871-6a08-4a3f-a5ee-ab3bad0d7d4d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:15.547321 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-2fe6a871-6a08-4a3f-a5ee-ab3bad0d7d4d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:15.554681 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2fe6a871-6a08-4a3f-a5ee-ab3bad0d7d4d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:15.555135 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2fe6a871-6a08-4a3f-a5ee-ab3bad0d7d4d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:15.555895 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2fe6a871-6a08-4a3f-a5ee-ab3bad0d7d4d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:15.556332 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-2fe6a871-6a08-4a3f-a5ee-ab3bad0d7d4d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:15.685724 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-2fe6a871-6a08-4a3f-a5ee-ab3bad0d7d4d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:15.693391 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-2fe6a871-6a08-4a3f-a5ee-ab3bad0d7d4d tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 200 len: 1366 microversion: 2.1 time: 0.150533 Aug 01 14:32:15.693990 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 564/1130] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:15 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:16.443536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-765064bf-3c05-4d42-8045-21514bb6d967 req-95cb44b9-015e-4859-8e58-23105bf2c21a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852e5cfc-24b4-460f-ae55-36324df2b28f", "name": "network-vif-plugged", "status": "completed", "tag": "a89af0fa-47f7-4b80-9d56-7676b463a893"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:16.453097 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-765064bf-3c05-4d42-8045-21514bb6d967 req-95cb44b9-015e-4859-8e58-23105bf2c21a service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:16.453519 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-765064bf-3c05-4d42-8045-21514bb6d967 req-95cb44b9-015e-4859-8e58-23105bf2c21a service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:16.467445 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-765064bf-3c05-4d42-8045-21514bb6d967 req-95cb44b9-015e-4859-8e58-23105bf2c21a service nova] Creating event network-vif-plugged:a89af0fa-47f7-4b80-9d56-7676b463a893 for instance 852e5cfc-24b4-460f-ae55-36324df2b28f on hv-cinder-78729 Aug 01 14:32:16.473084 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-765064bf-3c05-4d42-8045-21514bb6d967 req-95cb44b9-015e-4859-8e58-23105bf2c21a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148932 Aug 01 14:32:16.473734 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 567/1131] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:32:16.714169 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4ab33df1-a3af-43de-846f-dd6038ac52f1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:16.714727 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4ab33df1-a3af-43de-846f-dd6038ac52f1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:16.721154 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4ab33df1-a3af-43de-846f-dd6038ac52f1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:16.721602 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4ab33df1-a3af-43de-846f-dd6038ac52f1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:16.723299 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4ab33df1-a3af-43de-846f-dd6038ac52f1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:16.723811 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4ab33df1-a3af-43de-846f-dd6038ac52f1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:16.858141 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4ab33df1-a3af-43de-846f-dd6038ac52f1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:16.866708 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4ab33df1-a3af-43de-846f-dd6038ac52f1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 200 len: 1366 microversion: 2.1 time: 0.156496 Aug 01 14:32:16.867282 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 565/1132] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:16 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:17.886115 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=2 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:17.887043 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=6 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:17.891648 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-09477bc9-3d82-47ea-aa55-eeef031c49e1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:17.892355 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-09477bc9-3d82-47ea-aa55-eeef031c49e1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:17.899108 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-09477bc9-3d82-47ea-aa55-eeef031c49e1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:17.899493 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-09477bc9-3d82-47ea-aa55-eeef031c49e1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:17.900258 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-09477bc9-3d82-47ea-aa55-eeef031c49e1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:17.900691 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-09477bc9-3d82-47ea-aa55-eeef031c49e1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:18.030140 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-09477bc9-3d82-47ea-aa55-eeef031c49e1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:18.038058 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-09477bc9-3d82-47ea-aa55-eeef031c49e1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 200 len: 1366 microversion: 2.1 time: 0.152872 Aug 01 14:32:18.038620 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 568/1133] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:17 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:19.059330 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-df40e112-9843-4596-a637-a64c69f13017 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:19.059878 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-df40e112-9843-4596-a637-a64c69f13017 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:19.061852 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=6 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:19.068217 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-df40e112-9843-4596-a637-a64c69f13017 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:19.068714 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-df40e112-9843-4596-a637-a64c69f13017 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:19.069657 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-df40e112-9843-4596-a637-a64c69f13017 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:19.070175 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-df40e112-9843-4596-a637-a64c69f13017 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:19.198355 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-df40e112-9843-4596-a637-a64c69f13017 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:19.205641 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-df40e112-9843-4596-a637-a64c69f13017 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 200 len: 1556 microversion: 2.1 time: 0.150243 Aug 01 14:32:19.206236 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 566/1134] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:19 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:19.225892 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-441e2324-f1f3-4f26-b9dd-cd2b0708b3d5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:19.226423 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-441e2324-f1f3-4f26-b9dd-cd2b0708b3d5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:19.232835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-441e2324-f1f3-4f26-b9dd-cd2b0708b3d5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:19.233295 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-441e2324-f1f3-4f26-b9dd-cd2b0708b3d5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:19.234093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-441e2324-f1f3-4f26-b9dd-cd2b0708b3d5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:19.234536 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-441e2324-f1f3-4f26-b9dd-cd2b0708b3d5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:19.315081 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-441e2324-f1f3-4f26-b9dd-cd2b0708b3d5 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093232 Aug 01 14:32:19.315675 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 569/1135] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Aug 1 14:32:19 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:32:20.596399 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-a53a7d3f-3334-4e6f-a061-8fd324ce93c7 req-d45b8053-e9d9-48fc-8f5c-ea31500f9ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852e5cfc-24b4-460f-ae55-36324df2b28f", "tag": "a89af0fa-47f7-4b80-9d56-7676b463a893"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:20.605998 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-a53a7d3f-3334-4e6f-a061-8fd324ce93c7 req-d45b8053-e9d9-48fc-8f5c-ea31500f9ec1 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:20.606447 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-a53a7d3f-3334-4e6f-a061-8fd324ce93c7 req-d45b8053-e9d9-48fc-8f5c-ea31500f9ec1 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:20.618173 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-a53a7d3f-3334-4e6f-a061-8fd324ce93c7 req-d45b8053-e9d9-48fc-8f5c-ea31500f9ec1 service nova] Creating event network-changed:a89af0fa-47f7-4b80-9d56-7676b463a893 for instance 852e5cfc-24b4-460f-ae55-36324df2b28f on hv-cinder-78729 Aug 01 14:32:20.622989 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-a53a7d3f-3334-4e6f-a061-8fd324ce93c7 req-d45b8053-e9d9-48fc-8f5c-ea31500f9ec1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089800 Aug 01 14:32:20.623650 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 567/1136] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:32:29.059354 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-730ca0d3-487b-44b3-96dd-1f74bab25b20 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-428686936"}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:29.059908 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-730ca0d3-487b-44b3-96dd-1f74bab25b20 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:29.066025 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-730ca0d3-487b-44b3-96dd-1f74bab25b20 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:29.066475 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-730ca0d3-487b-44b3-96dd-1f74bab25b20 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:29.067243 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-730ca0d3-487b-44b3-96dd-1f74bab25b20 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:29.067672 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-730ca0d3-487b-44b3-96dd-1f74bab25b20 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:29.197902 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.network.security_group_api [None req-730ca0d3-487b-44b3-96dd-1f74bab25b20 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Removing security group eef6e302-9d1d-44b4-bdf7-78f7ca988ecc from port 2d661070-4d21-4715-be5d-845fc083bf67 Aug 01 14:32:29.571518 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-730ca0d3-487b-44b3-96dd-1f74bab25b20 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "POST /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/action" status: 202 len: 0 microversion: 2.1 time: 0.517752 Aug 01 14:32:29.572149 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 570/1137] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Aug 1 14:32:29 2022] POST /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:32:29.582684 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-fae581ab-089a-4c5d-b2d0-ebaf27dadc44 req-c996a181-8dcc-4c97-978a-38bdbf1a1663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f818132-d74c-4e1d-80d2-26fbc8d68325", "tag": "2d661070-4d21-4715-be5d-845fc083bf67"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:29.593453 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-fae581ab-089a-4c5d-b2d0-ebaf27dadc44 req-c996a181-8dcc-4c97-978a-38bdbf1a1663 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:29.594217 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-fae581ab-089a-4c5d-b2d0-ebaf27dadc44 req-c996a181-8dcc-4c97-978a-38bdbf1a1663 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:29.608282 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-fae581ab-089a-4c5d-b2d0-ebaf27dadc44 req-c996a181-8dcc-4c97-978a-38bdbf1a1663 service nova] Creating event network-changed:2d661070-4d21-4715-be5d-845fc083bf67 for instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 on hv-cinder-78729 Aug 01 14:32:29.614385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-fae581ab-089a-4c5d-b2d0-ebaf27dadc44 req-c996a181-8dcc-4c97-978a-38bdbf1a1663 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036509 Aug 01 14:32:29.615788 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 568/1138] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:32:29.844767 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:32:29.845037 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Mon Aug 1 14:32:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:32:30.867492 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-57d48841-0cf6-4c62-ad59-43980573f7fa tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:30.868042 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-57d48841-0cf6-4c62-ad59-43980573f7fa tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:30.874089 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-57d48841-0cf6-4c62-ad59-43980573f7fa tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:30.874549 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-57d48841-0cf6-4c62-ad59-43980573f7fa tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:30.875325 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-57d48841-0cf6-4c62-ad59-43980573f7fa tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:30.875775 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-57d48841-0cf6-4c62-ad59-43980573f7fa tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:30.957297 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-57d48841-0cf6-4c62-ad59-43980573f7fa tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lazy-loading 'services' on Instance uuid 5f818132-d74c-4e1d-80d2-26fbc8d68325 {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:32:31.219568 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-57d48841-0cf6-4c62-ad59-43980573f7fa tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/os-volume_attachments/b758cc3f-2728-430c-802b-ee20b328aa0e" status: 202 len: 0 microversion: 2.1 time: 0.357291 Aug 01 14:32:31.220175 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 571/1139] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Aug 1 14:32:30 2022] DELETE /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/os-volume_attachments/b758cc3f-2728-430c-802b-ee20b328aa0e => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:32:31.230990 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c38704e4-c4d4-4268-acb0-ff0d137ead0b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:31.234162 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c38704e4-c4d4-4268-acb0-ff0d137ead0b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:31.248028 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c38704e4-c4d4-4268-acb0-ff0d137ead0b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:31.248487 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c38704e4-c4d4-4268-acb0-ff0d137ead0b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:31.249269 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c38704e4-c4d4-4268-acb0-ff0d137ead0b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:31.249714 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c38704e4-c4d4-4268-acb0-ff0d137ead0b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:31.279354 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c38704e4-c4d4-4268-acb0-ff0d137ead0b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053517 Aug 01 14:32:31.279942 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 569/1140] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:32:31 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:32:31.633402 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-4ceb685f-2456-42aa-bc0f-745fac13c990 req-a963e2f9-5c10-4280-b113-024eb3562e30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f818132-d74c-4e1d-80d2-26fbc8d68325", "tag": "2d661070-4d21-4715-be5d-845fc083bf67"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:31.643623 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-4ceb685f-2456-42aa-bc0f-745fac13c990 req-a963e2f9-5c10-4280-b113-024eb3562e30 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:31.644075 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-4ceb685f-2456-42aa-bc0f-745fac13c990 req-a963e2f9-5c10-4280-b113-024eb3562e30 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:31.656547 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-4ceb685f-2456-42aa-bc0f-745fac13c990 req-a963e2f9-5c10-4280-b113-024eb3562e30 service nova] Creating event network-changed:2d661070-4d21-4715-be5d-845fc083bf67 for instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 on hv-cinder-78729 Aug 01 14:32:31.661631 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-4ceb685f-2456-42aa-bc0f-745fac13c990 req-a963e2f9-5c10-4280-b113-024eb3562e30 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032889 Aug 01 14:32:31.662910 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 572/1141] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:32:32.291807 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b4a29752-3eda-4bb7-832a-31963b0fe888 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:32.294126 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b4a29752-3eda-4bb7-832a-31963b0fe888 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:32.300306 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b4a29752-3eda-4bb7-832a-31963b0fe888 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:32.300760 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b4a29752-3eda-4bb7-832a-31963b0fe888 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:32.301536 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b4a29752-3eda-4bb7-832a-31963b0fe888 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:32.301998 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b4a29752-3eda-4bb7-832a-31963b0fe888 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:32.335865 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b4a29752-3eda-4bb7-832a-31963b0fe888 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047475 Aug 01 14:32:32.336689 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 570/1142] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:32:32 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:32:33.349551 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-6807034c-bc42-4806-9fc4-dcf705229fd2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:33.352706 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-6807034c-bc42-4806-9fc4-dcf705229fd2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:33.358892 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6807034c-bc42-4806-9fc4-dcf705229fd2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:33.359340 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6807034c-bc42-4806-9fc4-dcf705229fd2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:33.360104 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6807034c-bc42-4806-9fc4-dcf705229fd2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:33.360535 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-6807034c-bc42-4806-9fc4-dcf705229fd2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:33.389063 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-6807034c-bc42-4806-9fc4-dcf705229fd2 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044433 Aug 01 14:32:33.389630 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 573/1143] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:32:33 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:32:33.400549 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1b149e30-14ab-4adb-b59e-1b571bbd46ae tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:33.401058 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-1b149e30-14ab-4adb-b59e-1b571bbd46ae tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:33.407445 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1b149e30-14ab-4adb-b59e-1b571bbd46ae tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:33.407901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1b149e30-14ab-4adb-b59e-1b571bbd46ae tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:33.408668 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1b149e30-14ab-4adb-b59e-1b571bbd46ae tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:33.409106 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-1b149e30-14ab-4adb-b59e-1b571bbd46ae tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:33.482747 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-1b149e30-14ab-4adb-b59e-1b571bbd46ae tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] HTTP exception thrown: Instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 is not attached to volume b758cc3f-2728-430c-802b-ee20b328aa0e Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1b149e30-14ab-4adb-b59e-1b571bbd46ae tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Request method failure captured: Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: DELETE /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/os-volume_attachments/b758cc3f-2728-430c-802b-ee20b328aa0e HTTP/1.1 Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-N0W4Li9V2UxcE5KRsD6cj0c05xSZXQUtNXufoIc13VOJ0kB6yhAbZZXtQU0CJPBGXWRjYBXwdiXaIfkGUNAFYY1jCg3Imf3nI8iZihgPp1qUzUBwvlR-UDwS9tAThuZ5pNlypuQpIP7WQ9PxPAAWDN6wvMf3IjUCJEBXzRYvXAmCQ Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: 937e807649094f70844259eafaef26b1 Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-TestMinimumBasicScenario-1883132089 Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:32:33.485114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:32:33.486845 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/937e807649094f70844259eafaef26b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_937e807649094f70844259eafaef26b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/937e807649094f70844259eafaef26b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/937e807649094f70844259eafaef26b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:32:33.486845 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-TestMinimumBasicScenario-1883132089 Aug 01 14:32:33.486845 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: 937e807649094f70844259eafaef26b1 Aug 01 14:32:33.486845 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1883132089 Aug 01 14:32:33.486845 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-TestMinimumBasicScenario-1883132089-project Aug 01 14:32:33.486845 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:32:33.486845 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:32:33.486845 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: 0f18192b9dd241909b1957a7d43858c3 Aug 01 14:32:33.486845 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-TestMinimumBasicScenario-1883132089-project Aug 01 14:32:33.486845 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:32:33.486845 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 is not attached to volume b758cc3f-2728-430c-802b-ee20b328aa0e Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'server_id': '5f818132-d74c-4e1d-80d2-26fbc8d68325', 'id': 'b758cc3f-2728-430c-802b-ee20b328aa0e'} Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b758cc3f-2728-430c-802b-ee20b328aa0e. Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:32:33.487956 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:32:33.489462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:32:33.489462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 01 14:32:33.489462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 01 14:32:33.489462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 is not attached to volume b758cc3f-2728-430c-802b-ee20b328aa0e Aug 01 14:32:33.489462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:32:33.489462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:32:33.489462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:32:33.489462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:32:33.489462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:32:33.489462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:32:33.489462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:32:33.489462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:32:33.489462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 is not attached to volume b758cc3f-2728-430c-802b-ee20b328aa0e Aug 01 14:32:33.489462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:32:33.489462 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-1b149e30-14ab-4adb-b59e-1b571bbd46ae tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Returning 404 to user: Instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 is not attached to volume b758cc3f-2728-430c-802b-ee20b328aa0e {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:32:33.490661 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-1b149e30-14ab-4adb-b59e-1b571bbd46ae tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/os-volume_attachments/b758cc3f-2728-430c-802b-ee20b328aa0e" status: 404 len: 154 microversion: 2.1 time: 0.090723 Aug 01 14:32:33.490661 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 571/1144] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Aug 1 14:32:33 2022] DELETE /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325/os-volume_attachments/b758cc3f-2728-430c-802b-ee20b328aa0e => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:32:34.738117 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e48628d6-2e9a-4610-be17-85368f3fc712 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:34.738628 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e48628d6-2e9a-4610-be17-85368f3fc712 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:34.745284 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e48628d6-2e9a-4610-be17-85368f3fc712 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:34.745746 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e48628d6-2e9a-4610-be17-85368f3fc712 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:34.746553 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e48628d6-2e9a-4610-be17-85368f3fc712 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:34.747007 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e48628d6-2e9a-4610-be17-85368f3fc712 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:34.771910 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e48628d6-2e9a-4610-be17-85368f3fc712 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Going to try to terminate instance {{(pid=118247) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:32:35.065438 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e48628d6-2e9a-4610-be17-85368f3fc712 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 204 len: 0 microversion: 2.1 time: 0.331122 Aug 01 14:32:35.066076 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 574/1145] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:32:34 2022] DELETE /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:32:35.076095 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7783031e-80ff-4fb5-bb7d-966472bec3e1 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:35.076095 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7783031e-80ff-4fb5-bb7d-966472bec3e1 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:35.082227 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7783031e-80ff-4fb5-bb7d-966472bec3e1 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:35.082673 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7783031e-80ff-4fb5-bb7d-966472bec3e1 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:35.083470 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7783031e-80ff-4fb5-bb7d-966472bec3e1 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:35.083901 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7783031e-80ff-4fb5-bb7d-966472bec3e1 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:35.216343 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7783031e-80ff-4fb5-bb7d-966472bec3e1 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:35.223696 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7783031e-80ff-4fb5-bb7d-966472bec3e1 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1552 microversion: 2.1 time: 0.152860 Aug 01 14:32:35.224248 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 572/1146] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:35 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:32:36.245199 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a772bbc4-2670-4424-9e94-6f463ca55763 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:36.245945 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a772bbc4-2670-4424-9e94-6f463ca55763 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:36.252449 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a772bbc4-2670-4424-9e94-6f463ca55763 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:36.252907 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a772bbc4-2670-4424-9e94-6f463ca55763 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:36.253681 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a772bbc4-2670-4424-9e94-6f463ca55763 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:36.254150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a772bbc4-2670-4424-9e94-6f463ca55763 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:36.387147 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a772bbc4-2670-4424-9e94-6f463ca55763 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:36.394569 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a772bbc4-2670-4424-9e94-6f463ca55763 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1552 microversion: 2.1 time: 0.153852 Aug 01 14:32:36.395131 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 575/1147] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:36 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:37.415920 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-01c983f1-36e0-4471-bb24-7987fc6dad75 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:37.416550 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-01c983f1-36e0-4471-bb24-7987fc6dad75 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:37.423054 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-01c983f1-36e0-4471-bb24-7987fc6dad75 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:37.423503 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-01c983f1-36e0-4471-bb24-7987fc6dad75 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:37.424316 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-01c983f1-36e0-4471-bb24-7987fc6dad75 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:37.424709 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-01c983f1-36e0-4471-bb24-7987fc6dad75 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:37.553639 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-01c983f1-36e0-4471-bb24-7987fc6dad75 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:37.561796 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-01c983f1-36e0-4471-bb24-7987fc6dad75 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1552 microversion: 2.1 time: 0.149826 Aug 01 14:32:37.562363 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 573/1148] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:37 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:37.839906 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-3b2b7f2a-468d-475a-a849-0c56a14ef01b req-eb34c3e5-410a-41ee-8b2d-f073672e3185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f818132-d74c-4e1d-80d2-26fbc8d68325", "name": "network-vif-deleted", "tag": "2d661070-4d21-4715-be5d-845fc083bf67"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:37.852467 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-3b2b7f2a-468d-475a-a849-0c56a14ef01b req-eb34c3e5-410a-41ee-8b2d-f073672e3185 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:37.852467 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-3b2b7f2a-468d-475a-a849-0c56a14ef01b req-eb34c3e5-410a-41ee-8b2d-f073672e3185 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:37.861153 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-3b2b7f2a-468d-475a-a849-0c56a14ef01b req-eb34c3e5-410a-41ee-8b2d-f073672e3185 service nova] Creating event network-vif-deleted:2d661070-4d21-4715-be5d-845fc083bf67 for instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 on hv-cinder-78729 Aug 01 14:32:37.866801 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-3b2b7f2a-468d-475a-a849-0c56a14ef01b req-eb34c3e5-410a-41ee-8b2d-f073672e3185 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030308 Aug 01 14:32:37.867554 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 576/1149] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:32:38.583123 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-e43895c0-f088-4ac4-b684-81c14ca5f60b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:38.583742 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-e43895c0-f088-4ac4-b684-81c14ca5f60b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:38.590819 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e43895c0-f088-4ac4-b684-81c14ca5f60b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:38.591277 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e43895c0-f088-4ac4-b684-81c14ca5f60b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:38.592044 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e43895c0-f088-4ac4-b684-81c14ca5f60b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:38.592486 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e43895c0-f088-4ac4-b684-81c14ca5f60b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:38.623812 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e43895c0-f088-4ac4-b684-81c14ca5f60b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:38.624266 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-e43895c0-f088-4ac4-b684-81c14ca5f60b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:38.624722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-e43895c0-f088-4ac4-b684-81c14ca5f60b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lazy-loading 'fault' on Instance uuid 5f818132-d74c-4e1d-80d2-26fbc8d68325 {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:32:38.665713 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-e43895c0-f088-4ac4-b684-81c14ca5f60b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f18192b9dd241909b1957a7d43858c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937e807649094f70844259eafaef26b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:32:38.673130 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-e43895c0-f088-4ac4-b684-81c14ca5f60b tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 200 len: 1346 microversion: 2.1 time: 0.093903 Aug 01 14:32:38.673694 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 574/1150] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:38 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:32:39.700662 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c1a08eea-c6a0-474c-9fac-ff13237cdc51 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:39.701368 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c1a08eea-c6a0-474c-9fac-ff13237cdc51 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] [instance: 5f818132-d74c-4e1d-80d2-26fbc8d68325] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:39.707722 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c1a08eea-c6a0-474c-9fac-ff13237cdc51 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:39.708179 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c1a08eea-c6a0-474c-9fac-ff13237cdc51 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:39.708952 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c1a08eea-c6a0-474c-9fac-ff13237cdc51 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:39.709397 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c1a08eea-c6a0-474c-9fac-ff13237cdc51 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:39.723248 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-c1a08eea-c6a0-474c-9fac-ff13237cdc51 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] HTTP exception thrown: Instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 could not be found. Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c1a08eea-c6a0-474c-9fac-ff13237cdc51 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Request method failure captured: Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 HTTP/1.1 Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-N0W4Li9V2UxcE5KRsD6cj0c05xSZXQUtNXufoIc13VOJ0kB6yhAbZZXtQU0CJPBGXWRjYBXwdiXaIfkGUNAFYY1jCg3Imf3nI8iZihgPp1qUzUBwvlR-UDwS9tAThuZ5pNlypuQpIP7WQ9PxPAAWDN6wvMf3IjUCJEBXzRYvXAmCQ Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: 937e807649094f70844259eafaef26b1 Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-TestMinimumBasicScenario-1883132089 Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:32:39.724858 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:32:39.726674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/937e807649094f70844259eafaef26b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_937e807649094f70844259eafaef26b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/937e807649094f70844259eafaef26b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/937e807649094f70844259eafaef26b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:32:39.726674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-TestMinimumBasicScenario-1883132089 Aug 01 14:32:39.726674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: 937e807649094f70844259eafaef26b1 Aug 01 14:32:39.726674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1883132089 Aug 01 14:32:39.726674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-TestMinimumBasicScenario-1883132089-project Aug 01 14:32:39.726674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:32:39.726674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:32:39.726674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: 0f18192b9dd241909b1957a7d43858c3 Aug 01 14:32:39.726674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-TestMinimumBasicScenario-1883132089-project Aug 01 14:32:39.726674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:32:39.726674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 could not be found. Aug 01 14:32:39.726674 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '5f818132-d74c-4e1d-80d2-26fbc8d68325'} Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 could not be found. Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:32:39.727650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 could not be found. Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 could not be found. Aug 01 14:32:39.729227 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:32:39.730643 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c1a08eea-c6a0-474c-9fac-ff13237cdc51 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Returning 404 to user: Instance 5f818132-d74c-4e1d-80d2-26fbc8d68325 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:32:39.730643 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c1a08eea-c6a0-474c-9fac-ff13237cdc51 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325" status: 404 len: 111 microversion: 2.1 time: 0.030543 Aug 01 14:32:39.730643 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 577/1151] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:32:39 2022] GET /compute/v2.1/servers/5f818132-d74c-4e1d-80d2-26fbc8d68325 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:32:39.735094 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-12b6048d-60d4-4093-b9d5-5ee5c5dad544 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] Calling method '.version_select at 0x7fb2560a0ca0>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:39.839219 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-12b6048d-60d4-4093-b9d5-5ee5c5dad544 tempest-TestMinimumBasicScenario-1883132089 tempest-TestMinimumBasicScenario-1883132089-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-663382889" status: 202 len: 0 microversion: 2.1 time: 0.107885 Aug 01 14:32:39.839794 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 575/1152] 10.222.0.49 () {58 vars in 1269 bytes} [Mon Aug 1 14:32:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-663382889 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:32:55.207924 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-b85b1d3c-3194-42b9-b042-9f2fbc871f10 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:32:55.208606 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-b85b1d3c-3194-42b9-b042-9f2fbc871f10 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:55.210800 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:55.215932 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:55.216188 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b85b1d3c-3194-42b9-b042-9f2fbc871f10 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:55.216650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b85b1d3c-3194-42b9-b042-9f2fbc871f10 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:55.217415 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b85b1d3c-3194-42b9-b042-9f2fbc871f10 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:55.217882 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-b85b1d3c-3194-42b9-b042-9f2fbc871f10 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:55.240636 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-b85b1d3c-3194-42b9-b042-9f2fbc871f10 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f/ips" status: 200 len: 149 microversion: 2.1 time: 0.036606 Aug 01 14:32:55.241189 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 578/1153] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Aug 1 14:32:55 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:32:56.910159 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=69 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:56.911015 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:56.915085 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-04d3b37d-cb0e-4aec-b41b-03b5f9744727 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfde0efb-95d4-447c-b6b0-4f15868eeb8c"}} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:32:56.918177 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-04d3b37d-cb0e-4aec-b41b-03b5f9744727 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:32:56.925508 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-04d3b37d-cb0e-4aec-b41b-03b5f9744727 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:56.925508 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-04d3b37d-cb0e-4aec-b41b-03b5f9744727 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:56.926054 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-04d3b37d-cb0e-4aec-b41b-03b5f9744727 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:32:56.926489 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-04d3b37d-cb0e-4aec-b41b-03b5f9744727 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:32:57.765935 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-04d3b37d-cb0e-4aec-b41b-03b5f9744727 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "POST /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.856763 Aug 01 14:32:57.766539 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 576/1154] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Aug 1 14:32:56 2022] POST /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f/os-volume_attachments => generated 194 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:33:01.304673 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-3bba56e9-59dc-4eef-acaa-b8e60e06a082 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-984023449", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-544331128", "security_groups": [{"name": "tempest-secgroup-smoke-1690971366"}], "block_device_mapping_v2": [{"uuid": "e66c24b0-ad0b-434a-9f20-549c1837e42e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "30f01bf7-4722-4776-930d-9ee72a3389f9"}]}} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:33:01.423043 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.network.neutron [None req-3bba56e9-59dc-4eef-acaa-b8e60e06a082 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] validate_networks() for [('30f01bf7-4722-4776-930d-9ee72a3389f9', None, None, None, None, None)] {{(pid=118247) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:33:01.794273 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-3bba56e9-59dc-4eef-acaa-b8e60e06a082 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Flavor limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:33:01.794747 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-3bba56e9-59dc-4eef-acaa-b8e60e06a082 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Image limits 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:33:01.795251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-3bba56e9-59dc-4eef-acaa-b8e60e06a082 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Flavor pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:33:01.795693 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-3bba56e9-59dc-4eef-acaa-b8e60e06a082 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Image pref 0:0:0 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:33:01.796140 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.virt.hardware [None req-3bba56e9-59dc-4eef-acaa-b8e60e06a082 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118247) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:33:01.805229 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3bba56e9-59dc-4eef-acaa-b8e60e06a082 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:01.805682 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3bba56e9-59dc-4eef-acaa-b8e60e06a082 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:01.806529 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3bba56e9-59dc-4eef-acaa-b8e60e06a082 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:01.806972 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-3bba56e9-59dc-4eef-acaa-b8e60e06a082 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:01.823554 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-3bba56e9-59dc-4eef-acaa-b8e60e06a082 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Getting quotas for project 1d34ed67668c475695dbd57530aa6d49. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:33:01.827905 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.quota [None req-3bba56e9-59dc-4eef-acaa-b8e60e06a082 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Getting quotas for user cc8d9f649a43450da28c0f7c2e4515ec and project 1d34ed67668c475695dbd57530aa6d49. Resources: {'ram', 'cores', 'instances'} {{(pid=118247) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:33:01.888357 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3bba56e9-59dc-4eef-acaa-b8e60e06a082 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Going to run 1 instances... {{(pid=118247) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:33:01.889957 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-3bba56e9-59dc-4eef-acaa-b8e60e06a082 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e66c24b0-ad0b-434a-9f20-549c1837e42e',volume_size=None,volume_type=None)] {{(pid=118247) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:33:02.397924 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-3bba56e9-59dc-4eef-acaa-b8e60e06a082 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.096947 Aug 01 14:33:02.398561 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 579/1155] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Aug 1 14:33:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:33:02.410600 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4d392dba-1c42-4290-8504-0f25b4123392 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:02.411373 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4d392dba-1c42-4290-8504-0f25b4123392 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:02.468641 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4d392dba-1c42-4290-8504-0f25b4123392 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:02.476547 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4d392dba-1c42-4290-8504-0f25b4123392 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1093 microversion: 2.1 time: 0.070112 Aug 01 14:33:02.477168 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 577/1156] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:02 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:03.498192 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a4150e26-126f-491d-9a9b-a5851c8bc14c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:03.498811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a4150e26-126f-491d-9a9b-a5851c8bc14c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:03.506032 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a4150e26-126f-491d-9a9b-a5851c8bc14c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:03.506488 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a4150e26-126f-491d-9a9b-a5851c8bc14c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:03.507264 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a4150e26-126f-491d-9a9b-a5851c8bc14c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:03.507709 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a4150e26-126f-491d-9a9b-a5851c8bc14c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:03.568300 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-a4150e26-126f-491d-9a9b-a5851c8bc14c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:03.576583 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a4150e26-126f-491d-9a9b-a5851c8bc14c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1143 microversion: 2.1 time: 0.082808 Aug 01 14:33:03.577159 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 580/1157] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:03 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:04.597060 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-4cc23bf9-54ce-4290-b16c-cbc9dec463e8 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:04.597745 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-4cc23bf9-54ce-4290-b16c-cbc9dec463e8 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:04.606773 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4cc23bf9-54ce-4290-b16c-cbc9dec463e8 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:04.607223 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4cc23bf9-54ce-4290-b16c-cbc9dec463e8 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:04.608035 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4cc23bf9-54ce-4290-b16c-cbc9dec463e8 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:04.608471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-4cc23bf9-54ce-4290-b16c-cbc9dec463e8 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:04.677309 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-4cc23bf9-54ce-4290-b16c-cbc9dec463e8 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:04.685570 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-4cc23bf9-54ce-4290-b16c-cbc9dec463e8 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1199 microversion: 2.1 time: 0.092288 Aug 01 14:33:04.686181 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 578/1158] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:04 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1199 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:05.706801 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-19cbe5b7-9bb1-4c0b-a49e-de423547160d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:05.708133 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-19cbe5b7-9bb1-4c0b-a49e-de423547160d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:05.715004 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-19cbe5b7-9bb1-4c0b-a49e-de423547160d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:05.715659 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-19cbe5b7-9bb1-4c0b-a49e-de423547160d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:05.716364 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-19cbe5b7-9bb1-4c0b-a49e-de423547160d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:05.716762 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-19cbe5b7-9bb1-4c0b-a49e-de423547160d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:05.853741 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-19cbe5b7-9bb1-4c0b-a49e-de423547160d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:05.862346 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-19cbe5b7-9bb1-4c0b-a49e-de423547160d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1277 microversion: 2.1 time: 0.159367 Aug 01 14:33:05.862915 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 581/1159] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:05 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:06.595985 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-da5fe34a-25ca-4261-9feb-c9e1cb92c861 req-6e134331-ef99-452c-8c5a-6552a6ed59a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ca9b10-2e2a-4eac-af7f-73d34e1597d8", "tag": "0c60bf9f-3a3d-4e04-b6df-f3725629a5ae"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:33:06.607268 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-da5fe34a-25ca-4261-9feb-c9e1cb92c861 req-6e134331-ef99-452c-8c5a-6552a6ed59a2 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:06.610433 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-da5fe34a-25ca-4261-9feb-c9e1cb92c861 req-6e134331-ef99-452c-8c5a-6552a6ed59a2 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:06.619722 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-da5fe34a-25ca-4261-9feb-c9e1cb92c861 req-6e134331-ef99-452c-8c5a-6552a6ed59a2 service nova] Creating event network-changed:0c60bf9f-3a3d-4e04-b6df-f3725629a5ae for instance 84ca9b10-2e2a-4eac-af7f-73d34e1597d8 on hv-cinder-78729 Aug 01 14:33:06.625384 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-da5fe34a-25ca-4261-9feb-c9e1cb92c861 req-6e134331-ef99-452c-8c5a-6552a6ed59a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034167 Aug 01 14:33:06.626383 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 579/1160] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:33:06.884375 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-27cfcc32-20ef-4a5e-8cf2-0e0060f7d544 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:06.885003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-27cfcc32-20ef-4a5e-8cf2-0e0060f7d544 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:06.891844 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-27cfcc32-20ef-4a5e-8cf2-0e0060f7d544 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:06.892301 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-27cfcc32-20ef-4a5e-8cf2-0e0060f7d544 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:06.893083 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-27cfcc32-20ef-4a5e-8cf2-0e0060f7d544 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:06.893525 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-27cfcc32-20ef-4a5e-8cf2-0e0060f7d544 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:07.035752 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-27cfcc32-20ef-4a5e-8cf2-0e0060f7d544 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:07.046885 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-27cfcc32-20ef-4a5e-8cf2-0e0060f7d544 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1277 microversion: 2.1 time: 0.164359 Aug 01 14:33:07.046885 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 582/1161] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:06 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:07.601797 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-b93f22c8-e2b0-4713-aa53-ee9df0f54325 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:07.602386 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-b93f22c8-e2b0-4713-aa53-ee9df0f54325 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:07.609390 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b93f22c8-e2b0-4713-aa53-ee9df0f54325 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:07.609911 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b93f22c8-e2b0-4713-aa53-ee9df0f54325 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:07.610663 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b93f22c8-e2b0-4713-aa53-ee9df0f54325 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:07.611121 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-b93f22c8-e2b0-4713-aa53-ee9df0f54325 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:07.692262 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.objects.instance [None req-b93f22c8-e2b0-4713-aa53-ee9df0f54325 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lazy-loading 'services' on Instance uuid 852e5cfc-24b4-460f-ae55-36324df2b28f {{(pid=118246) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:33:07.961182 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-b93f22c8-e2b0-4713-aa53-ee9df0f54325 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "DELETE /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f/os-volume_attachments/cfde0efb-95d4-447c-b6b0-4f15868eeb8c" status: 202 len: 0 microversion: 2.1 time: 0.363373 Aug 01 14:33:07.962058 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 580/1162] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Aug 1 14:33:07 2022] DELETE /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f/os-volume_attachments/cfde0efb-95d4-447c-b6b0-4f15868eeb8c => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:33:07.970755 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-431defd6-8755-4774-a66f-4263c2eb9fce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:07.973662 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-431defd6-8755-4774-a66f-4263c2eb9fce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:07.983209 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-431defd6-8755-4774-a66f-4263c2eb9fce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:07.983820 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-431defd6-8755-4774-a66f-4263c2eb9fce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:07.984698 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-431defd6-8755-4774-a66f-4263c2eb9fce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:07.985376 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-431defd6-8755-4774-a66f-4263c2eb9fce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:08.018360 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-431defd6-8755-4774-a66f-4263c2eb9fce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051452 Aug 01 14:33:08.018902 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 583/1163] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:33:07 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:33:08.066642 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-d3d9a782-7e18-429b-9f2e-ded78f653a3c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:08.067255 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-d3d9a782-7e18-429b-9f2e-ded78f653a3c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:08.073470 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d3d9a782-7e18-429b-9f2e-ded78f653a3c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:08.077273 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d3d9a782-7e18-429b-9f2e-ded78f653a3c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:08.077273 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d3d9a782-7e18-429b-9f2e-ded78f653a3c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:08.077273 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-d3d9a782-7e18-429b-9f2e-ded78f653a3c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:08.214260 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-d3d9a782-7e18-429b-9f2e-ded78f653a3c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:08.222618 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-d3d9a782-7e18-429b-9f2e-ded78f653a3c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1277 microversion: 2.1 time: 0.160706 Aug 01 14:33:08.223154 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 581/1164] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:08 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:09.031411 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-5ab88bac-2030-4e1f-b522-4d34d2689f87 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:09.033605 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-5ab88bac-2030-4e1f-b522-4d34d2689f87 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:09.040401 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5ab88bac-2030-4e1f-b522-4d34d2689f87 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:09.040856 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5ab88bac-2030-4e1f-b522-4d34d2689f87 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:09.041630 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5ab88bac-2030-4e1f-b522-4d34d2689f87 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:09.042096 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-5ab88bac-2030-4e1f-b522-4d34d2689f87 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:09.071951 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-5ab88bac-2030-4e1f-b522-4d34d2689f87 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044989 Aug 01 14:33:09.072532 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 584/1165] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:33:09 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:33:09.242375 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-f9a048e0-7033-4025-bc33-47d0fba73eb7 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:09.242991 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-f9a048e0-7033-4025-bc33-47d0fba73eb7 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:09.250127 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f9a048e0-7033-4025-bc33-47d0fba73eb7 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:09.250577 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f9a048e0-7033-4025-bc33-47d0fba73eb7 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:09.251343 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f9a048e0-7033-4025-bc33-47d0fba73eb7 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:09.251789 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-f9a048e0-7033-4025-bc33-47d0fba73eb7 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:09.382169 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-f9a048e0-7033-4025-bc33-47d0fba73eb7 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:09.390477 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-f9a048e0-7033-4025-bc33-47d0fba73eb7 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1265 microversion: 2.1 time: 0.151942 Aug 01 14:33:09.391042 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 582/1166] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:09 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:10.086144 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-71f86f5d-d9c5-4263-a9f5-a664e12b1b3a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:10.088346 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-71f86f5d-d9c5-4263-a9f5-a664e12b1b3a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:10.095466 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-71f86f5d-d9c5-4263-a9f5-a664e12b1b3a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:10.095922 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-71f86f5d-d9c5-4263-a9f5-a664e12b1b3a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:10.099578 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-71f86f5d-d9c5-4263-a9f5-a664e12b1b3a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:10.099578 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-71f86f5d-d9c5-4263-a9f5-a664e12b1b3a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:10.127081 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-71f86f5d-d9c5-4263-a9f5-a664e12b1b3a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044965 Aug 01 14:33:10.136081 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 585/1167] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Aug 1 14:33:10 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:33:10.191146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-92bef893-2b31-419f-8ad3-aa51fe80210c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:10.191646 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-92bef893-2b31-419f-8ad3-aa51fe80210c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:10.197662 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-92bef893-2b31-419f-8ad3-aa51fe80210c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:10.199565 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-92bef893-2b31-419f-8ad3-aa51fe80210c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:10.199565 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-92bef893-2b31-419f-8ad3-aa51fe80210c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:10.200197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-92bef893-2b31-419f-8ad3-aa51fe80210c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:10.226150 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-92bef893-2b31-419f-8ad3-aa51fe80210c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Going to try to terminate instance {{(pid=118246) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:33:10.411543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-33b6f8c2-0437-4144-9fec-ad57861c9c2a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:10.412066 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-33b6f8c2-0437-4144-9fec-ad57861c9c2a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:10.418229 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-33b6f8c2-0437-4144-9fec-ad57861c9c2a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:10.418677 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-33b6f8c2-0437-4144-9fec-ad57861c9c2a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:10.419440 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-33b6f8c2-0437-4144-9fec-ad57861c9c2a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:10.419878 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-33b6f8c2-0437-4144-9fec-ad57861c9c2a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:10.521926 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-92bef893-2b31-419f-8ad3-aa51fe80210c tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "DELETE /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 204 len: 0 microversion: 2.1 time: 0.334331 Aug 01 14:33:10.522709 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 583/1168] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:33:10 2022] DELETE /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:33:10.532296 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c6361164-9208-416d-ad62-43e4799edc8f tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:10.533029 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c6361164-9208-416d-ad62-43e4799edc8f tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:10.539139 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c6361164-9208-416d-ad62-43e4799edc8f tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:10.539588 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c6361164-9208-416d-ad62-43e4799edc8f tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:10.540358 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c6361164-9208-416d-ad62-43e4799edc8f tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:10.540794 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c6361164-9208-416d-ad62-43e4799edc8f tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:10.559500 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-33b6f8c2-0437-4144-9fec-ad57861c9c2a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:10.567843 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-33b6f8c2-0437-4144-9fec-ad57861c9c2a tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1265 microversion: 2.1 time: 0.159859 Aug 01 14:33:10.568418 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 586/1169] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:10 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:33:10.674655 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-c6361164-9208-416d-ad62-43e4799edc8f tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:10.682218 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c6361164-9208-416d-ad62-43e4799edc8f tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 200 len: 1680 microversion: 2.1 time: 0.155110 Aug 01 14:33:10.682787 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 584/1170] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:10 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:33:11.589081 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-0b518ad9-8b23-4b71-9da1-038db60a18dd tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:11.589846 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-0b518ad9-8b23-4b71-9da1-038db60a18dd tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:11.596457 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b518ad9-8b23-4b71-9da1-038db60a18dd tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:11.598544 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b518ad9-8b23-4b71-9da1-038db60a18dd tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:11.598544 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b518ad9-8b23-4b71-9da1-038db60a18dd tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:11.598544 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-0b518ad9-8b23-4b71-9da1-038db60a18dd tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:11.704914 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7eff50e1-f1b1-45e7-a131-9c32e15adebc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:11.705531 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7eff50e1-f1b1-45e7-a131-9c32e15adebc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:11.712061 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7eff50e1-f1b1-45e7-a131-9c32e15adebc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:11.712513 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7eff50e1-f1b1-45e7-a131-9c32e15adebc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:11.713355 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7eff50e1-f1b1-45e7-a131-9c32e15adebc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:11.713802 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7eff50e1-f1b1-45e7-a131-9c32e15adebc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:11.731269 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-0b518ad9-8b23-4b71-9da1-038db60a18dd tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:11.739147 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-0b518ad9-8b23-4b71-9da1-038db60a18dd tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1265 microversion: 2.1 time: 0.154041 Aug 01 14:33:11.739725 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 587/1171] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:11 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:11.847717 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7eff50e1-f1b1-45e7-a131-9c32e15adebc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:11.855436 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7eff50e1-f1b1-45e7-a131-9c32e15adebc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 200 len: 1680 microversion: 2.1 time: 0.154411 Aug 01 14:33:11.856014 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 585/1172] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:11 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:12.760613 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-e12cc420-e0bc-4a5d-9396-b7c0ca02ada1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:12.761316 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-e12cc420-e0bc-4a5d-9396-b7c0ca02ada1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:12.763616 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=2 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:12.764416 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell0:SELECT=6 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:12.770333 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e12cc420-e0bc-4a5d-9396-b7c0ca02ada1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:12.770789 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e12cc420-e0bc-4a5d-9396-b7c0ca02ada1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:12.771584 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e12cc420-e0bc-4a5d-9396-b7c0ca02ada1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:12.772617 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-e12cc420-e0bc-4a5d-9396-b7c0ca02ada1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:12.876615 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-65f03cf8-d59a-4d9c-b56d-9ddaa31f2b08 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:12.878199 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-65f03cf8-d59a-4d9c-b56d-9ddaa31f2b08 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:12.880789 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell0:SELECT=2 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:12.886938 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-65f03cf8-d59a-4d9c-b56d-9ddaa31f2b08 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:12.887424 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-65f03cf8-d59a-4d9c-b56d-9ddaa31f2b08 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:12.888354 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-65f03cf8-d59a-4d9c-b56d-9ddaa31f2b08 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:12.889270 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-65f03cf8-d59a-4d9c-b56d-9ddaa31f2b08 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:12.943196 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-e12cc420-e0bc-4a5d-9396-b7c0ca02ada1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:12.951479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-e12cc420-e0bc-4a5d-9396-b7c0ca02ada1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1265 microversion: 2.1 time: 0.194785 Aug 01 14:33:12.952372 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 588/1173] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:12 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:13.038864 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-65f03cf8-d59a-4d9c-b56d-9ddaa31f2b08 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:13.047332 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-65f03cf8-d59a-4d9c-b56d-9ddaa31f2b08 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 200 len: 1680 microversion: 2.1 time: 0.174466 Aug 01 14:33:13.047904 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 586/1174] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:12 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:33:13.599000 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-59c83443-e3fb-461d-af03-b25efbc489d2 req-e5f7d5c4-f252-4f60-b206-6a6479a09be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852e5cfc-24b4-460f-ae55-36324df2b28f", "name": "network-vif-deleted", "tag": "a89af0fa-47f7-4b80-9d56-7676b463a893"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:33:13.610058 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-59c83443-e3fb-461d-af03-b25efbc489d2 req-e5f7d5c4-f252-4f60-b206-6a6479a09be4 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:13.615021 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-59c83443-e3fb-461d-af03-b25efbc489d2 req-e5f7d5c4-f252-4f60-b206-6a6479a09be4 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:13.624382 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-59c83443-e3fb-461d-af03-b25efbc489d2 req-e5f7d5c4-f252-4f60-b206-6a6479a09be4 service nova] Creating event network-vif-deleted:a89af0fa-47f7-4b80-9d56-7676b463a893 for instance 852e5cfc-24b4-460f-ae55-36324df2b28f on hv-cinder-78729 Aug 01 14:33:13.633441 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-59c83443-e3fb-461d-af03-b25efbc489d2 req-e5f7d5c4-f252-4f60-b206-6a6479a09be4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037994 Aug 01 14:33:13.634529 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 589/1175] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:33:13.987114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3cf6e772-e972-4fa5-af93-13318fa19da9 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:13.987114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3cf6e772-e972-4fa5-af93-13318fa19da9 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:13.987114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3cf6e772-e972-4fa5-af93-13318fa19da9 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:13.987114 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3cf6e772-e972-4fa5-af93-13318fa19da9 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:13.987971 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3cf6e772-e972-4fa5-af93-13318fa19da9 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:13.987971 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3cf6e772-e972-4fa5-af93-13318fa19da9 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:14.070158 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-cee34b7f-ec21-456f-8455-bb7bad23001e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:14.071474 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-cee34b7f-ec21-456f-8455-bb7bad23001e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:14.079892 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cee34b7f-ec21-456f-8455-bb7bad23001e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:14.080354 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cee34b7f-ec21-456f-8455-bb7bad23001e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:14.081141 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cee34b7f-ec21-456f-8455-bb7bad23001e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:14.081586 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cee34b7f-ec21-456f-8455-bb7bad23001e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:14.115420 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cee34b7f-ec21-456f-8455-bb7bad23001e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:14.115881 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-cee34b7f-ec21-456f-8455-bb7bad23001e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:14.116356 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-cee34b7f-ec21-456f-8455-bb7bad23001e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lazy-loading 'fault' on Instance uuid 852e5cfc-24b4-460f-ae55-36324df2b28f {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:33:14.120054 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-3cf6e772-e972-4fa5-af93-13318fa19da9 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:14.128516 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3cf6e772-e972-4fa5-af93-13318fa19da9 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1265 microversion: 2.1 time: 0.158695 Aug 01 14:33:14.132193 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 587/1176] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:13 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:33:14.159727 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-cee34b7f-ec21-456f-8455-bb7bad23001e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:14.167421 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-cee34b7f-ec21-456f-8455-bb7bad23001e tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 200 len: 1330 microversion: 2.1 time: 0.102491 Aug 01 14:33:14.168047 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 590/1177] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:14 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:15.149907 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0efe6e4d-6860-42ed-abea-297784f9bf98 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:15.150522 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0efe6e4d-6860-42ed-abea-297784f9bf98 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:15.157561 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0efe6e4d-6860-42ed-abea-297784f9bf98 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:15.158051 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0efe6e4d-6860-42ed-abea-297784f9bf98 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:15.158819 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0efe6e4d-6860-42ed-abea-297784f9bf98 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:15.159266 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0efe6e4d-6860-42ed-abea-297784f9bf98 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:15.188959 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-9df543ee-27ec-4aef-abb3-8971883be740 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:15.189699 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-9df543ee-27ec-4aef-abb3-8971883be740 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:15.196320 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9df543ee-27ec-4aef-abb3-8971883be740 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:15.196777 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9df543ee-27ec-4aef-abb3-8971883be740 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:15.197579 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9df543ee-27ec-4aef-abb3-8971883be740 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:15.198056 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9df543ee-27ec-4aef-abb3-8971883be740 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:15.237295 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9df543ee-27ec-4aef-abb3-8971883be740 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:15.237799 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-9df543ee-27ec-4aef-abb3-8971883be740 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:15.238221 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-9df543ee-27ec-4aef-abb3-8971883be740 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lazy-loading 'fault' on Instance uuid 852e5cfc-24b4-460f-ae55-36324df2b28f {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:33:15.289777 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-9df543ee-27ec-4aef-abb3-8971883be740 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb29845a13844f89fd004b401d27b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6df4baf0a1242f2b73fe99071682355', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:15.296896 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-9df543ee-27ec-4aef-abb3-8971883be740 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 200 len: 1330 microversion: 2.1 time: 0.111693 Aug 01 14:33:15.297462 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 591/1178] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:15 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 1330 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:15.322015 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-0efe6e4d-6860-42ed-abea-297784f9bf98 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:15.330479 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0efe6e4d-6860-42ed-abea-297784f9bf98 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1265 microversion: 2.1 time: 0.184527 Aug 01 14:33:15.331041 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 588/1179] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:15 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:16.318982 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-24c1cfc1-2cc4-47a5-bde1-12f812df9189 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:16.319598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-24c1cfc1-2cc4-47a5-bde1-12f812df9189 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:16.326660 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-24c1cfc1-2cc4-47a5-bde1-12f812df9189 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:16.327111 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-24c1cfc1-2cc4-47a5-bde1-12f812df9189 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:16.328085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-24c1cfc1-2cc4-47a5-bde1-12f812df9189 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:16.328546 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-24c1cfc1-2cc4-47a5-bde1-12f812df9189 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:16.342228 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-24c1cfc1-2cc4-47a5-bde1-12f812df9189 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] HTTP exception thrown: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-24c1cfc1-2cc4-47a5-bde1-12f812df9189 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Request method failure captured: Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f HTTP/1.1 Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-L0M5WO8nDE0q1CG-Np5H3kIUpdYJfyjx92RxgagSas2PQX4zcSsYAcbMGYJoVR82J_bQyPwI-P3t2LR46Kh_WLn_u4I3f3WhblPY-X4bycK9lCMByrTu1qFbUY82UF9aEod0Q_XtMLge0BwV8zmcLvEk0eUJbXm4ubmcvI5bVAbbs Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:33:16.343853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:33:16.345499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:33:16.345499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:16.345499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:16.345499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:16.345499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:16.345499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:33:16.345499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:33:16.345499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: fbb29845a13844f89fd004b401d27b8e Aug 01 14:33:16.345499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:16.345499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:33:16.345499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. Aug 01 14:33:16.345499 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '852e5cfc-24b4-460f-ae55-36324df2b28f'} Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:33:16.346678 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. Aug 01 14:33:16.348390 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:16.350087 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-24c1cfc1-2cc4-47a5-bde1-12f812df9189 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Returning 404 to user: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:33:16.350087 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-24c1cfc1-2cc4-47a5-bde1-12f812df9189 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 404 len: 111 microversion: 2.1 time: 0.030241 Aug 01 14:33:16.350087 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 592/1180] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:16 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:33:16.350932 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-a2eee161-784a-4b10-ac55-a7167748d578 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:16.351550 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-a2eee161-784a-4b10-ac55-a7167748d578 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:16.354975 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c26d118b-70a2-4a15-a695-dfa3652fcb2a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '.version_select at 0x7fb24f734550>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:16.358162 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a2eee161-784a-4b10-ac55-a7167748d578 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:16.358612 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a2eee161-784a-4b10-ac55-a7167748d578 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:16.360321 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a2eee161-784a-4b10-ac55-a7167748d578 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:16.360761 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-a2eee161-784a-4b10-ac55-a7167748d578 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:16.427680 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c26d118b-70a2-4a15-a695-dfa3652fcb2a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-492819403" status: 202 len: 0 microversion: 2.1 time: 0.075408 Aug 01 14:33:16.428913 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 593/1181] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Aug 1 14:33:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-492819403 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:33:16.527567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-a2eee161-784a-4b10-ac55-a7167748d578 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:16.535385 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-a2eee161-784a-4b10-ac55-a7167748d578 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1265 microversion: 2.1 time: 0.188076 Aug 01 14:33:16.535974 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 589/1182] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:16 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:17.557236 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-eb680321-280d-475a-b896-124914fd54ba tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:17.557867 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-eb680321-280d-475a-b896-124914fd54ba tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:17.564656 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-eb680321-280d-475a-b896-124914fd54ba tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:17.565103 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-eb680321-280d-475a-b896-124914fd54ba tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:17.565895 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-eb680321-280d-475a-b896-124914fd54ba tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:17.566333 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-eb680321-280d-475a-b896-124914fd54ba tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:17.695468 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-eb680321-280d-475a-b896-124914fd54ba tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:17.703656 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-eb680321-280d-475a-b896-124914fd54ba tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1265 microversion: 2.1 time: 0.150729 Aug 01 14:33:17.704215 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 594/1183] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:17 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:18.512927 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-767a45c7-b0ca-4ebe-a224-74a7cfdda8aa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:18.513627 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-767a45c7-b0ca-4ebe-a224-74a7cfdda8aa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:18.520098 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-767a45c7-b0ca-4ebe-a224-74a7cfdda8aa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:18.520555 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-767a45c7-b0ca-4ebe-a224-74a7cfdda8aa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:18.521332 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-767a45c7-b0ca-4ebe-a224-74a7cfdda8aa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:18.521804 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-767a45c7-b0ca-4ebe-a224-74a7cfdda8aa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:18.537482 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-767a45c7-b0ca-4ebe-a224-74a7cfdda8aa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] HTTP exception thrown: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-767a45c7-b0ca-4ebe-a224-74a7cfdda8aa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Request method failure captured: Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: DELETE /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f HTTP/1.1 Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-L0M5WO8nDE0q1CG-Np5H3kIUpdYJfyjx92RxgagSas2PQX4zcSsYAcbMGYJoVR82J_bQyPwI-P3t2LR46Kh_WLn_u4I3f3WhblPY-X4bycK9lCMByrTu1qFbUY82UF9aEod0Q_XtMLge0BwV8zmcLvEk0eUJbXm4ubmcvI5bVAbbs Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:33:18.539184 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:33:18.540770 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:33:18.540770 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:18.540770 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:18.540770 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:18.540770 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:18.540770 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:33:18.540770 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:33:18.540770 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: fbb29845a13844f89fd004b401d27b8e Aug 01 14:33:18.540770 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:18.540770 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:33:18.540770 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. Aug 01 14:33:18.540770 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': '852e5cfc-24b4-460f-ae55-36324df2b28f'} Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:33:18.541899 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. Aug 01 14:33:18.551092 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:18.552537 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-767a45c7-b0ca-4ebe-a224-74a7cfdda8aa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Returning 404 to user: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:33:18.552537 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-767a45c7-b0ca-4ebe-a224-74a7cfdda8aa tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "DELETE /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 404 len: 111 microversion: 2.1 time: 0.031696 Aug 01 14:33:18.552537 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 590/1184] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:33:18 2022] DELETE /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:33:18.552835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-33b1e3b4-21c6-4e04-b78c-7815858042bc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:18.552835 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-33b1e3b4-21c6-4e04-b78c-7815858042bc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 852e5cfc-24b4-460f-ae55-36324df2b28f] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:18.557260 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-33b1e3b4-21c6-4e04-b78c-7815858042bc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:18.557899 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-33b1e3b4-21c6-4e04-b78c-7815858042bc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:18.558642 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-33b1e3b4-21c6-4e04-b78c-7815858042bc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:18.559086 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-33b1e3b4-21c6-4e04-b78c-7815858042bc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:18.574094 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-33b1e3b4-21c6-4e04-b78c-7815858042bc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] HTTP exception thrown: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-33b1e3b4-21c6-4e04-b78c-7815858042bc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Request method failure captured: Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f HTTP/1.1 Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-L0M5WO8nDE0q1CG-Np5H3kIUpdYJfyjx92RxgagSas2PQX4zcSsYAcbMGYJoVR82J_bQyPwI-P3t2LR46Kh_WLn_u4I3f3WhblPY-X4bycK9lCMByrTu1qFbUY82UF9aEod0Q_XtMLge0BwV8zmcLvEk0eUJbXm4ubmcvI5bVAbbs Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:33:18.576166 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:33:18.578543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:33:18.578543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:18.578543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:18.578543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:18.578543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:18.578543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:33:18.578543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:33:18.578543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: fbb29845a13844f89fd004b401d27b8e Aug 01 14:33:18.578543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:18.578543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:33:18.578543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. Aug 01 14:33:18.578543 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '852e5cfc-24b4-460f-ae55-36324df2b28f'} Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:33:18.580473 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. Aug 01 14:33:18.582093 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:18.584251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-33b1e3b4-21c6-4e04-b78c-7815858042bc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Returning 404 to user: Instance 852e5cfc-24b4-460f-ae55-36324df2b28f could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:33:18.584251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-33b1e3b4-21c6-4e04-b78c-7815858042bc tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f" status: 404 len: 111 microversion: 2.1 time: 0.031751 Aug 01 14:33:18.584251 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 595/1185] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:18 2022] GET /compute/v2.1/servers/852e5cfc-24b4-460f-ae55-36324df2b28f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:33:18.631584 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-db518c9e-bafc-4e30-a7ad-24e70829ec56 req-f91e7db9-3a76-401a-ad7d-0311daa2caa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ca9b10-2e2a-4eac-af7f-73d34e1597d8", "name": "network-vif-plugged", "status": "completed", "tag": "0c60bf9f-3a3d-4e04-b6df-f3725629a5ae"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:33:18.642523 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-db518c9e-bafc-4e30-a7ad-24e70829ec56 req-f91e7db9-3a76-401a-ad7d-0311daa2caa7 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:18.642994 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-db518c9e-bafc-4e30-a7ad-24e70829ec56 req-f91e7db9-3a76-401a-ad7d-0311daa2caa7 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:18.647183 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:18.656394 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-db518c9e-bafc-4e30-a7ad-24e70829ec56 req-f91e7db9-3a76-401a-ad7d-0311daa2caa7 service nova] Creating event network-vif-plugged:0c60bf9f-3a3d-4e04-b6df-f3725629a5ae for instance 84ca9b10-2e2a-4eac-af7f-73d34e1597d8 on hv-cinder-78729 Aug 01 14:33:18.661865 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-db518c9e-bafc-4e30-a7ad-24e70829ec56 req-f91e7db9-3a76-401a-ad7d-0311daa2caa7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034686 Aug 01 14:33:18.662605 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 591/1186] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:33:18.734526 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-09a2cfa5-cd5a-4a54-99c6-aa58badd2d4c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:18.734526 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-09a2cfa5-cd5a-4a54-99c6-aa58badd2d4c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:18.737082 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-09a2cfa5-cd5a-4a54-99c6-aa58badd2d4c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:18.737647 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-09a2cfa5-cd5a-4a54-99c6-aa58badd2d4c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:18.738575 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-09a2cfa5-cd5a-4a54-99c6-aa58badd2d4c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:18.739021 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-09a2cfa5-cd5a-4a54-99c6-aa58badd2d4c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:18.880637 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-09a2cfa5-cd5a-4a54-99c6-aa58badd2d4c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:18.888791 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-09a2cfa5-cd5a-4a54-99c6-aa58badd2d4c tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1265 microversion: 2.1 time: 0.167689 Aug 01 14:33:18.889406 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 596/1187] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:18 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:33:19.911834 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7257113b-18a3-46cd-a6c7-51c64be17525 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:19.912529 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7257113b-18a3-46cd-a6c7-51c64be17525 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:19.919261 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7257113b-18a3-46cd-a6c7-51c64be17525 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:19.920779 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7257113b-18a3-46cd-a6c7-51c64be17525 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:19.921101 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7257113b-18a3-46cd-a6c7-51c64be17525 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:19.921544 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7257113b-18a3-46cd-a6c7-51c64be17525 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:20.054627 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7257113b-18a3-46cd-a6c7-51c64be17525 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:20.074707 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7257113b-18a3-46cd-a6c7-51c64be17525 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1265 microversion: 2.1 time: 0.156136 Aug 01 14:33:20.074707 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 592/1188] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:19 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:20.183222 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a6c8adbb-cf22-4e30-bc63-a79911334f31 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:20.183717 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-a6c8adbb-cf22-4e30-bc63-a79911334f31 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:20.190273 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a6c8adbb-cf22-4e30-bc63-a79911334f31 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:20.190723 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a6c8adbb-cf22-4e30-bc63-a79911334f31 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:20.191486 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a6c8adbb-cf22-4e30-bc63-a79911334f31 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:20.191958 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-a6c8adbb-cf22-4e30-bc63-a79911334f31 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:20.205772 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-a6c8adbb-cf22-4e30-bc63-a79911334f31 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] HTTP exception thrown: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a6c8adbb-cf22-4e30-bc63-a79911334f31 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Request method failure captured: Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: DELETE /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 HTTP/1.1 Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-L0M5WO8nDE0q1CG-Np5H3kIUpdYJfyjx92RxgagSas2PQX4zcSsYAcbMGYJoVR82J_bQyPwI-P3t2LR46Kh_WLn_u4I3f3WhblPY-X4bycK9lCMByrTu1qFbUY82UF9aEod0Q_XtMLge0BwV8zmcLvEk0eUJbXm4ubmcvI5bVAbbs Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:33:20.207327 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:33:20.208985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:33:20.208985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:20.208985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:20.208985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:20.208985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:20.208985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:33:20.208985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:33:20.208985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: fbb29845a13844f89fd004b401d27b8e Aug 01 14:33:20.208985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:20.208985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:33:20.208985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. Aug 01 14:33:20.208985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': 'be92eb56-b7dd-481d-85ea-83ac3617db42'} Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:33:20.210053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. Aug 01 14:33:20.211619 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.213163 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-a6c8adbb-cf22-4e30-bc63-a79911334f31 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Returning 404 to user: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:33:20.213163 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-a6c8adbb-cf22-4e30-bc63-a79911334f31 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "DELETE /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 404 len: 111 microversion: 2.1 time: 0.029397 Aug 01 14:33:20.213163 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 597/1189] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:33:20 2022] DELETE /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:33:20.218080 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c01cf9d2-4424-4e56-86bf-64d47b89e9a1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:20.220884 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-c01cf9d2-4424-4e56-86bf-64d47b89e9a1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: be92eb56-b7dd-481d-85ea-83ac3617db42] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:20.224631 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c01cf9d2-4424-4e56-86bf-64d47b89e9a1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:20.225080 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c01cf9d2-4424-4e56-86bf-64d47b89e9a1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:20.225867 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c01cf9d2-4424-4e56-86bf-64d47b89e9a1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:20.226304 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-c01cf9d2-4424-4e56-86bf-64d47b89e9a1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:20.240170 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-c01cf9d2-4424-4e56-86bf-64d47b89e9a1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] HTTP exception thrown: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c01cf9d2-4424-4e56-86bf-64d47b89e9a1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Request method failure captured: Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 HTTP/1.1 Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-L0M5WO8nDE0q1CG-Np5H3kIUpdYJfyjx92RxgagSas2PQX4zcSsYAcbMGYJoVR82J_bQyPwI-P3t2LR46Kh_WLn_u4I3f3WhblPY-X4bycK9lCMByrTu1qFbUY82UF9aEod0Q_XtMLge0BwV8zmcLvEk0eUJbXm4ubmcvI5bVAbbs Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:33:20.241856 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:33:20.243505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:33:20.243505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:20.243505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:20.243505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:20.243505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:20.243505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:33:20.243505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:33:20.243505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: fbb29845a13844f89fd004b401d27b8e Aug 01 14:33:20.243505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:20.243505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:33:20.243505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. Aug 01 14:33:20.243505 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': 'be92eb56-b7dd-481d-85ea-83ac3617db42'} Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:33:20.244471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. Aug 01 14:33:20.249530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.251179 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-c01cf9d2-4424-4e56-86bf-64d47b89e9a1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Returning 404 to user: Instance be92eb56-b7dd-481d-85ea-83ac3617db42 could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:33:20.251179 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-c01cf9d2-4424-4e56-86bf-64d47b89e9a1 tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42" status: 404 len: 111 microversion: 2.1 time: 0.030184 Aug 01 14:33:20.251179 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 593/1190] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:20 2022] GET /compute/v2.1/servers/be92eb56-b7dd-481d-85ea-83ac3617db42 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:33:20.252490 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4300e96e-f6f1-45de-aa1a-18511a3ca67b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:20.252991 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-4300e96e-f6f1-45de-aa1a-18511a3ca67b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:20.259018 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4300e96e-f6f1-45de-aa1a-18511a3ca67b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:20.259462 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4300e96e-f6f1-45de-aa1a-18511a3ca67b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:20.260217 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4300e96e-f6f1-45de-aa1a-18511a3ca67b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:20.260653 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-4300e96e-f6f1-45de-aa1a-18511a3ca67b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:20.275015 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-4300e96e-f6f1-45de-aa1a-18511a3ca67b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] HTTP exception thrown: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4300e96e-f6f1-45de-aa1a-18511a3ca67b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Request method failure captured: Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: DELETE /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 HTTP/1.1 Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-L0M5WO8nDE0q1CG-Np5H3kIUpdYJfyjx92RxgagSas2PQX4zcSsYAcbMGYJoVR82J_bQyPwI-P3t2LR46Kh_WLn_u4I3f3WhblPY-X4bycK9lCMByrTu1qFbUY82UF9aEod0Q_XtMLge0BwV8zmcLvEk0eUJbXm4ubmcvI5bVAbbs Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:33:20.280862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:33:20.282923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:33:20.282923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:20.282923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:20.282923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:20.282923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:20.282923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:33:20.282923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:33:20.282923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: fbb29845a13844f89fd004b401d27b8e Aug 01 14:33:20.282923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:20.282923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:33:20.282923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. Aug 01 14:33:20.282923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '6a608434-236b-4efe-82ff-2abf4d225423'} Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:33:20.283916 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. Aug 01 14:33:20.286003 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.287760 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-4300e96e-f6f1-45de-aa1a-18511a3ca67b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Returning 404 to user: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:33:20.287760 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-4300e96e-f6f1-45de-aa1a-18511a3ca67b tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 404 len: 111 microversion: 2.1 time: 0.029835 Aug 01 14:33:20.287760 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 598/1191] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:33:20 2022] DELETE /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:33:20.288039 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5679f39f-3197-4a29-b0a8-51daf12ad0ce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:20.288194 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5679f39f-3197-4a29-b0a8-51daf12ad0ce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: 6a608434-236b-4efe-82ff-2abf4d225423] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:20.294018 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5679f39f-3197-4a29-b0a8-51daf12ad0ce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:20.294463 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5679f39f-3197-4a29-b0a8-51daf12ad0ce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:20.295852 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5679f39f-3197-4a29-b0a8-51daf12ad0ce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:20.296287 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5679f39f-3197-4a29-b0a8-51daf12ad0ce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-5679f39f-3197-4a29-b0a8-51daf12ad0ce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] HTTP exception thrown: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5679f39f-3197-4a29-b0a8-51daf12ad0ce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Request method failure captured: Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 HTTP/1.1 Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-L0M5WO8nDE0q1CG-Np5H3kIUpdYJfyjx92RxgagSas2PQX4zcSsYAcbMGYJoVR82J_bQyPwI-P3t2LR46Kh_WLn_u4I3f3WhblPY-X4bycK9lCMByrTu1qFbUY82UF9aEod0Q_XtMLge0BwV8zmcLvEk0eUJbXm4ubmcvI5bVAbbs Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:33:20.319265 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:33:20.321208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:33:20.321208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:20.321208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:20.321208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:20.321208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:20.321208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:33:20.321208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:33:20.321208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: fbb29845a13844f89fd004b401d27b8e Aug 01 14:33:20.321208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:20.321208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:33:20.321208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. Aug 01 14:33:20.321208 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': '6a608434-236b-4efe-82ff-2abf4d225423'} Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:33:20.322197 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. Aug 01 14:33:20.323786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:20.325583 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5679f39f-3197-4a29-b0a8-51daf12ad0ce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Returning 404 to user: Instance 6a608434-236b-4efe-82ff-2abf4d225423 could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:33:20.325583 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5679f39f-3197-4a29-b0a8-51daf12ad0ce tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423" status: 404 len: 111 microversion: 2.1 time: 0.030194 Aug 01 14:33:20.325583 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 594/1192] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:20 2022] GET /compute/v2.1/servers/6a608434-236b-4efe-82ff-2abf4d225423 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:33:21.084397 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-04ebb3bf-9d4c-4627-bb3e-ee46322d0103 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:21.084938 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-04ebb3bf-9d4c-4627-bb3e-ee46322d0103 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:21.091143 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-04ebb3bf-9d4c-4627-bb3e-ee46322d0103 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:21.091601 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-04ebb3bf-9d4c-4627-bb3e-ee46322d0103 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:21.092371 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-04ebb3bf-9d4c-4627-bb3e-ee46322d0103 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:21.092811 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-04ebb3bf-9d4c-4627-bb3e-ee46322d0103 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:21.096874 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=100 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:21.223577 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-04ebb3bf-9d4c-4627-bb3e-ee46322d0103 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:21.231154 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-04ebb3bf-9d4c-4627-bb3e-ee46322d0103 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1453 microversion: 2.1 time: 0.150729 Aug 01 14:33:21.231719 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 599/1193] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:21 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:21.252515 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-7fa1c580-1cb4-4cfc-ab94-b216698e9b6d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:21.259544 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-7fa1c580-1cb4-4cfc-ab94-b216698e9b6d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:21.259544 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7fa1c580-1cb4-4cfc-ab94-b216698e9b6d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:21.259544 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7fa1c580-1cb4-4cfc-ab94-b216698e9b6d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:21.260324 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7fa1c580-1cb4-4cfc-ab94-b216698e9b6d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:21.260764 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-7fa1c580-1cb4-4cfc-ab94-b216698e9b6d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:21.391323 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-7fa1c580-1cb4-4cfc-ab94-b216698e9b6d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:33:21.398835 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-7fa1c580-1cb4-4cfc-ab94-b216698e9b6d tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1453 microversion: 2.1 time: 0.151246 Aug 01 14:33:21.399421 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 595/1194] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:21 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:33:21.571273 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ccc0fc86-6b93-4f32-a1d4-ccdfd5e060ee tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:21.571877 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-ccc0fc86-6b93-4f32-a1d4-ccdfd5e060ee tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:21.578817 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ccc0fc86-6b93-4f32-a1d4-ccdfd5e060ee tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:21.579270 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ccc0fc86-6b93-4f32-a1d4-ccdfd5e060ee tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:21.580047 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ccc0fc86-6b93-4f32-a1d4-ccdfd5e060ee tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:21.580492 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-ccc0fc86-6b93-4f32-a1d4-ccdfd5e060ee tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-ccc0fc86-6b93-4f32-a1d4-ccdfd5e060ee tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] HTTP exception thrown: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ccc0fc86-6b93-4f32-a1d4-ccdfd5e060ee tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Request method failure captured: Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: DELETE /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df HTTP/1.1 Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-L0M5WO8nDE0q1CG-Np5H3kIUpdYJfyjx92RxgagSas2PQX4zcSsYAcbMGYJoVR82J_bQyPwI-P3t2LR46Kh_WLn_u4I3f3WhblPY-X4bycK9lCMByrTu1qFbUY82UF9aEod0Q_XtMLge0BwV8zmcLvEk0eUJbXm4ubmcvI5bVAbbs Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:33:21.598150 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:33:21.599715 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:33:21.599715 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:21.599715 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:21.599715 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:21.599715 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:21.599715 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:33:21.599715 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:33:21.599715 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: fbb29845a13844f89fd004b401d27b8e Aug 01 14:33:21.599715 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:21.599715 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:33:21.599715 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. Aug 01 14:33:21.599715 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': 'f3117aae-0e0a-491a-aa97-8aa3f63615df'} Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:33:21.600479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. Aug 01 14:33:21.601737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:33:21.603137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-ccc0fc86-6b93-4f32-a1d4-ccdfd5e060ee tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Returning 404 to user: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:33:21.603137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-ccc0fc86-6b93-4f32-a1d4-ccdfd5e060ee tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 404 len: 111 microversion: 2.1 time: 0.032559 Aug 01 14:33:21.603137 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 600/1195] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:33:21 2022] DELETE /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:33:21.608530 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-493a7bc4-2efc-4f67-bf8e-7043961e8c8a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:33:21.609148 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-493a7bc4-2efc-4f67-bf8e-7043961e8c8a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] [instance: f3117aae-0e0a-491a-aa97-8aa3f63615df] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:33:21.615471 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-493a7bc4-2efc-4f67-bf8e-7043961e8c8a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:21.615922 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-493a7bc4-2efc-4f67-bf8e-7043961e8c8a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:21.616751 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-493a7bc4-2efc-4f67-bf8e-7043961e8c8a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:21.617195 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-493a7bc4-2efc-4f67-bf8e-7043961e8c8a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:21.630968 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-493a7bc4-2efc-4f67-bf8e-7043961e8c8a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] HTTP exception thrown: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-493a7bc4-2efc-4f67-bf8e-7043961e8c8a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Request method failure captured: Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df HTTP/1.1 Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-L0M5WO8nDE0q1CG-Np5H3kIUpdYJfyjx92RxgagSas2PQX4zcSsYAcbMGYJoVR82J_bQyPwI-P3t2LR46Kh_WLn_u4I3f3WhblPY-X4bycK9lCMByrTu1qFbUY82UF9aEod0Q_XtMLge0BwV8zmcLvEk0eUJbXm4ubmcvI5bVAbbs Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:33:21.632552 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:33:21.634205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c6df4baf0a1242f2b73fe99071682355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:33:21.634205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:21.634205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: c6df4baf0a1242f2b73fe99071682355 Aug 01 14:33:21.634205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863821698 Aug 01 14:33:21.634205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:21.634205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:33:21.634205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:33:21.634205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: fbb29845a13844f89fd004b401d27b8e Aug 01 14:33:21.634205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-AttachVolumeNegativeTest-1863821698-project Aug 01 14:33:21.634205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:33:21.634205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. Aug 01 14:33:21.634205 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': 'f3117aae-0e0a-491a-aa97-8aa3f63615df'} Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:33:21.635128 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. Aug 01 14:33:21.636598 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:33:21.637986 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-493a7bc4-2efc-4f67-bf8e-7043961e8c8a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] Returning 404 to user: Instance f3117aae-0e0a-491a-aa97-8aa3f63615df could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:33:21.637986 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-493a7bc4-2efc-4f67-bf8e-7043961e8c8a tempest-AttachVolumeNegativeTest-1863821698 tempest-AttachVolumeNegativeTest-1863821698-project] 10.222.0.49 "GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df" status: 404 len: 111 microversion: 2.1 time: 0.029516 Aug 01 14:33:21.637986 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 596/1196] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:33:21 2022] GET /compute/v2.1/servers/f3117aae-0e0a-491a-aa97-8aa3f63615df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:33:24.759582 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-0cd9b4f9-fe42-4310-8cff-16174cfe8669 req-e7877b11-d1f8-4da0-ab7f-e31813689553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ca9b10-2e2a-4eac-af7f-73d34e1597d8", "tag": "0c60bf9f-3a3d-4e04-b6df-f3725629a5ae"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:33:24.774164 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-0cd9b4f9-fe42-4310-8cff-16174cfe8669 req-e7877b11-d1f8-4da0-ab7f-e31813689553 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:33:24.774923 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-0cd9b4f9-fe42-4310-8cff-16174cfe8669 req-e7877b11-d1f8-4da0-ab7f-e31813689553 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:33:24.792794 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-0cd9b4f9-fe42-4310-8cff-16174cfe8669 req-e7877b11-d1f8-4da0-ab7f-e31813689553 service nova] Creating event network-changed:0c60bf9f-3a3d-4e04-b6df-f3725629a5ae for instance 84ca9b10-2e2a-4eac-af7f-73d34e1597d8 on hv-cinder-78729 Aug 01 14:33:24.798535 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-0cd9b4f9-fe42-4310-8cff-16174cfe8669 req-e7877b11-d1f8-4da0-ab7f-e31813689553 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042536 Aug 01 14:33:24.799725 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 601/1197] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:34:55.518329 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:55.519293 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG dbcounter [-] [118246] Writing DB stats nova_cell1:SELECT=18 {{(pid=118246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:55.520980 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:55.521899 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG dbcounter [-] [118247] Writing DB stats nova_cell1:SELECT=8 {{(pid=118247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:55.524744 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-22e2ef5b-0379-46f4-85e9-32d361be74e1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:55.525302 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-22e2ef5b-0379-46f4-85e9-32d361be74e1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:55.527434 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [req-ca43c0f5-78e9-4660-8bd7-244855ea9b57 req-a38493ca-2580-4699-95b2-93adc754e059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ca9b10-2e2a-4eac-af7f-73d34e1597d8", "tag": "0c60bf9f-3a3d-4e04-b6df-f3725629a5ae"}]} {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:34:55.536390 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-22e2ef5b-0379-46f4-85e9-32d361be74e1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:55.536390 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-22e2ef5b-0379-46f4-85e9-32d361be74e1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:55.536390 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-22e2ef5b-0379-46f4-85e9-32d361be74e1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:55.536390 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-22e2ef5b-0379-46f4-85e9-32d361be74e1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:55.537265 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-ca43c0f5-78e9-4660-8bd7-244855ea9b57 req-a38493ca-2580-4699-95b2-93adc754e059 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:55.537830 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [req-ca43c0f5-78e9-4660-8bd7-244855ea9b57 req-a38493ca-2580-4699-95b2-93adc754e059 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:55.549711 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.compute.server_external_events [req-ca43c0f5-78e9-4660-8bd7-244855ea9b57 req-a38493ca-2580-4699-95b2-93adc754e059 service nova] Creating event network-changed:0c60bf9f-3a3d-4e04-b6df-f3725629a5ae for instance 84ca9b10-2e2a-4eac-af7f-73d34e1597d8 on hv-cinder-78729 Aug 01 14:34:55.555590 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [req-ca43c0f5-78e9-4660-8bd7-244855ea9b57 req-a38493ca-2580-4699-95b2-93adc754e059 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036758 Aug 01 14:34:55.559075 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 602/1198] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:34:55.562522 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-22e2ef5b-0379-46f4-85e9-32d361be74e1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Going to try to terminate instance {{(pid=118246) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:34:55.882154 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-22e2ef5b-0379-46f4-85e9-32d361be74e1 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "DELETE /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 204 len: 0 microversion: 2.1 time: 0.364719 Aug 01 14:34:55.886162 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 597/1199] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:34:55 2022] DELETE /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:34:55.891671 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-bc34f978-89a3-426b-a8b0-ad710b34ca6f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:55.892368 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-bc34f978-89a3-426b-a8b0-ad710b34ca6f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:55.901090 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bc34f978-89a3-426b-a8b0-ad710b34ca6f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:55.902088 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bc34f978-89a3-426b-a8b0-ad710b34ca6f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:55.903383 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bc34f978-89a3-426b-a8b0-ad710b34ca6f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:55.904036 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-bc34f978-89a3-426b-a8b0-ad710b34ca6f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:56.048469 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-bc34f978-89a3-426b-a8b0-ad710b34ca6f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:34:56.056971 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-bc34f978-89a3-426b-a8b0-ad710b34ca6f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1578 microversion: 2.1 time: 0.169495 Aug 01 14:34:56.057546 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 603/1200] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:34:55 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:34:57.079756 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-36db16b1-a7ff-451d-9b10-eb3726e382ee tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:57.080458 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-36db16b1-a7ff-451d-9b10-eb3726e382ee tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:57.087667 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-36db16b1-a7ff-451d-9b10-eb3726e382ee tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:57.088121 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-36db16b1-a7ff-451d-9b10-eb3726e382ee tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:57.088928 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-36db16b1-a7ff-451d-9b10-eb3726e382ee tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:57.089364 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-36db16b1-a7ff-451d-9b10-eb3726e382ee tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:57.226296 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-36db16b1-a7ff-451d-9b10-eb3726e382ee tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:34:57.233129 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-36db16b1-a7ff-451d-9b10-eb3726e382ee tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1578 microversion: 2.1 time: 0.157775 Aug 01 14:34:57.233695 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 598/1201] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:34:57 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:34:58.255131 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-1892d430-5d9d-42b7-bd42-d2ebae997fbc tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:58.255748 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-1892d430-5d9d-42b7-bd42-d2ebae997fbc tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:58.263011 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1892d430-5d9d-42b7-bd42-d2ebae997fbc tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:58.263583 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1892d430-5d9d-42b7-bd42-d2ebae997fbc tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:58.264375 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1892d430-5d9d-42b7-bd42-d2ebae997fbc tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:58.264823 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-1892d430-5d9d-42b7-bd42-d2ebae997fbc tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:58.399599 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-1892d430-5d9d-42b7-bd42-d2ebae997fbc tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:34:58.407430 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-1892d430-5d9d-42b7-bd42-d2ebae997fbc tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1459 microversion: 2.1 time: 0.156624 Aug 01 14:34:58.408354 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 604/1202] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:34:58 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1459 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:34:58.576680 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-c92add18-3f89-4291-8b8b-6753f6f944e9 req-f547d9f4-d7fc-4b00-a0ca-f13cc62a46ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ca9b10-2e2a-4eac-af7f-73d34e1597d8", "name": "network-vif-deleted", "tag": "0c60bf9f-3a3d-4e04-b6df-f3725629a5ae"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:34:58.586146 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-c92add18-3f89-4291-8b8b-6753f6f944e9 req-f547d9f4-d7fc-4b00-a0ca-f13cc62a46ad service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:58.588460 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-c92add18-3f89-4291-8b8b-6753f6f944e9 req-f547d9f4-d7fc-4b00-a0ca-f13cc62a46ad service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:58.597537 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-c92add18-3f89-4291-8b8b-6753f6f944e9 req-f547d9f4-d7fc-4b00-a0ca-f13cc62a46ad service nova] Creating event network-vif-deleted:0c60bf9f-3a3d-4e04-b6df-f3725629a5ae for instance 84ca9b10-2e2a-4eac-af7f-73d34e1597d8 on hv-cinder-78729 Aug 01 14:34:58.603028 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-c92add18-3f89-4291-8b8b-6753f6f944e9 req-f547d9f4-d7fc-4b00-a0ca-f13cc62a46ad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030003 Aug 01 14:34:58.603615 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 599/1203] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:34:59.429275 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-51834156-3c6a-4bfa-a9d7-f7cf783b4341 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:34:59.430019 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-51834156-3c6a-4bfa-a9d7-f7cf783b4341 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:34:59.436493 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-51834156-3c6a-4bfa-a9d7-f7cf783b4341 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:59.436944 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-51834156-3c6a-4bfa-a9d7-f7cf783b4341 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:59.437709 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-51834156-3c6a-4bfa-a9d7-f7cf783b4341 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:59.438179 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-51834156-3c6a-4bfa-a9d7-f7cf783b4341 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:59.468917 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-51834156-3c6a-4bfa-a9d7-f7cf783b4341 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:34:59.469368 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-51834156-3c6a-4bfa-a9d7-f7cf783b4341 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:34:59.469853 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.objects.instance [None req-51834156-3c6a-4bfa-a9d7-f7cf783b4341 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lazy-loading 'fault' on Instance uuid 84ca9b10-2e2a-4eac-af7f-73d34e1597d8 {{(pid=118247) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:34:59.515084 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-51834156-3c6a-4bfa-a9d7-f7cf783b4341 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:34:59.522847 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-51834156-3c6a-4bfa-a9d7-f7cf783b4341 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 200 len: 1229 microversion: 2.1 time: 0.098254 Aug 01 14:34:59.523456 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 605/1204] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:34:59 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:35:00.545406 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0f116e79-6937-43d8-aa1d-558e6606bc8f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:35:00.546135 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-0f116e79-6937-43d8-aa1d-558e6606bc8f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 84ca9b10-2e2a-4eac-af7f-73d34e1597d8] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:35:00.552248 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0f116e79-6937-43d8-aa1d-558e6606bc8f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:00.552694 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0f116e79-6937-43d8-aa1d-558e6606bc8f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:00.554249 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0f116e79-6937-43d8-aa1d-558e6606bc8f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:00.554785 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-0f116e79-6937-43d8-aa1d-558e6606bc8f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:00.567787 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-0f116e79-6937-43d8-aa1d-558e6606bc8f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] HTTP exception thrown: Instance 84ca9b10-2e2a-4eac-af7f-73d34e1597d8 could not be found. Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0f116e79-6937-43d8-aa1d-558e6606bc8f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Request method failure captured: Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 HTTP/1.1 Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-LgBoQm9NvZLFBH-yE_GeuplVaQRb42-Xuimpm2ugydTxw7h7-9QWkFrt7vEpgW7P1Q11ML1sTN2o4o087oYdTKT4FIgIM6LjmAXCLwdVi1zhzM0jum_mcs2fL5KAxNQOM3G5J0vEz6yz_Iq3vUuga923dBcvYDq_OYMBn4-1BdQfI Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: 1d34ed67668c475695dbd57530aa6d49 Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-TestVolumeBootPattern-1973027885 Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:35:00.569496 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:35:00.571131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:35:00.571131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-TestVolumeBootPattern-1973027885 Aug 01 14:35:00.571131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: 1d34ed67668c475695dbd57530aa6d49 Aug 01 14:35:00.571131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-TestVolumeBootPattern-1973027885 Aug 01 14:35:00.571131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-TestVolumeBootPattern-1973027885-project Aug 01 14:35:00.571131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:35:00.571131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:35:00.571131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: cc8d9f649a43450da28c0f7c2e4515ec Aug 01 14:35:00.571131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-TestVolumeBootPattern-1973027885-project Aug 01 14:35:00.571131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:35:00.571131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance 84ca9b10-2e2a-4eac-af7f-73d34e1597d8 could not be found. Aug 01 14:35:00.571131 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': '84ca9b10-2e2a-4eac-af7f-73d34e1597d8'} Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ca9b10-2e2a-4eac-af7f-73d34e1597d8 could not be found. Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:35:00.572052 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ca9b10-2e2a-4eac-af7f-73d34e1597d8 could not be found. Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ca9b10-2e2a-4eac-af7f-73d34e1597d8 could not be found. Aug 01 14:35:00.573786 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:35:00.575705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-0f116e79-6937-43d8-aa1d-558e6606bc8f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Returning 404 to user: Instance 84ca9b10-2e2a-4eac-af7f-73d34e1597d8 could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:35:00.575705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-0f116e79-6937-43d8-aa1d-558e6606bc8f tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8" status: 404 len: 111 microversion: 2.1 time: 0.030214 Aug 01 14:35:00.575705 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 600/1205] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:35:00 2022] GET /compute/v2.1/servers/84ca9b10-2e2a-4eac-af7f-73d34e1597d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:35:03.870173 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-8cacc19f-b332-4c36-a030-003c6dd7b0b3 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:35:03.870727 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-8cacc19f-b332-4c36-a030-003c6dd7b0b3 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:35:03.872101 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-d253f4bb-90c7-41e1-85bb-4f3dc4d10049 req-9b3e848b-1449-4b2b-971f-6fe04875cf85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6731b91-eec1-464e-aa85-217a2a172493", "tag": "a7fb0259-103e-4ba9-b56f-00ca293e5f4d"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:35:03.877301 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8cacc19f-b332-4c36-a030-003c6dd7b0b3 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:03.877870 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8cacc19f-b332-4c36-a030-003c6dd7b0b3 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:03.878819 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8cacc19f-b332-4c36-a030-003c6dd7b0b3 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:03.879268 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-8cacc19f-b332-4c36-a030-003c6dd7b0b3 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:03.883537 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-d253f4bb-90c7-41e1-85bb-4f3dc4d10049 req-9b3e848b-1449-4b2b-971f-6fe04875cf85 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:03.884069 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-d253f4bb-90c7-41e1-85bb-4f3dc4d10049 req-9b3e848b-1449-4b2b-971f-6fe04875cf85 service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:03.895733 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-d253f4bb-90c7-41e1-85bb-4f3dc4d10049 req-9b3e848b-1449-4b2b-971f-6fe04875cf85 service nova] Creating event network-changed:a7fb0259-103e-4ba9-b56f-00ca293e5f4d for instance b6731b91-eec1-464e-aa85-217a2a172493 on hv-cinder-78729 Aug 01 14:35:03.902295 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-d253f4bb-90c7-41e1-85bb-4f3dc4d10049 req-9b3e848b-1449-4b2b-971f-6fe04875cf85 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033648 Aug 01 14:35:03.903284 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 601/1206] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:35:03.908249 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-8cacc19f-b332-4c36-a030-003c6dd7b0b3 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Going to try to terminate instance {{(pid=118247) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:35:04.131400 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-8cacc19f-b332-4c36-a030-003c6dd7b0b3 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 204 len: 0 microversion: 2.1 time: 0.265272 Aug 01 14:35:04.136156 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 606/1207] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:35:03 2022] DELETE /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:35:04.141855 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-804b0445-352a-489a-9d6b-3fa71fb31363 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:35:04.142567 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-804b0445-352a-489a-9d6b-3fa71fb31363 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:35:04.150091 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-804b0445-352a-489a-9d6b-3fa71fb31363 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:04.150545 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-804b0445-352a-489a-9d6b-3fa71fb31363 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:04.151328 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-804b0445-352a-489a-9d6b-3fa71fb31363 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:04.151765 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-804b0445-352a-489a-9d6b-3fa71fb31363 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:04.289968 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.policy [None req-804b0445-352a-489a-9d6b-3fa71fb31363 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118246) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:35:04.297526 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-804b0445-352a-489a-9d6b-3fa71fb31363 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1576 microversion: 2.1 time: 0.159911 Aug 01 14:35:04.312065 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 602/1208] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:35:04 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:35:05.320815 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-00c003b1-5a9d-4081-b47f-3db588442716 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:35:05.321526 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-00c003b1-5a9d-4081-b47f-3db588442716 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:35:05.327985 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-00c003b1-5a9d-4081-b47f-3db588442716 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:05.328432 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-00c003b1-5a9d-4081-b47f-3db588442716 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:05.329203 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-00c003b1-5a9d-4081-b47f-3db588442716 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:05.329644 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-00c003b1-5a9d-4081-b47f-3db588442716 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:05.465862 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-00c003b1-5a9d-4081-b47f-3db588442716 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:35:05.473277 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-00c003b1-5a9d-4081-b47f-3db588442716 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1576 microversion: 2.1 time: 0.157410 Aug 01 14:35:05.474187 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 607/1209] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:35:05 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:35:06.300304 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [req-d676ae1f-cb95-4fc0-86b2-fefbc8d41a67 req-92647d61-1be1-4924-90d5-0f0e32b1373d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6731b91-eec1-464e-aa85-217a2a172493", "name": "network-vif-deleted", "tag": "a7fb0259-103e-4ba9-b56f-00ca293e5f4d"}]} {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:35:06.310802 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-d676ae1f-cb95-4fc0-86b2-fefbc8d41a67 req-92647d61-1be1-4924-90d5-0f0e32b1373d service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:06.310802 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [req-d676ae1f-cb95-4fc0-86b2-fefbc8d41a67 req-92647d61-1be1-4924-90d5-0f0e32b1373d service nova] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:06.322212 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.compute.server_external_events [req-d676ae1f-cb95-4fc0-86b2-fefbc8d41a67 req-92647d61-1be1-4924-90d5-0f0e32b1373d service nova] Creating event network-vif-deleted:a7fb0259-103e-4ba9-b56f-00ca293e5f4d for instance b6731b91-eec1-464e-aa85-217a2a172493 on hv-cinder-78729 Aug 01 14:35:06.327011 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [req-d676ae1f-cb95-4fc0-86b2-fefbc8d41a67 req-92647d61-1be1-4924-90d5-0f0e32b1373d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032046 Aug 01 14:35:06.327591 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 603/1210] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Aug 1 14:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:35:06.497415 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-324b5d00-dcdf-4085-8825-43e033ddcb23 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:35:06.498053 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-324b5d00-dcdf-4085-8825-43e033ddcb23 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:35:06.504307 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-324b5d00-dcdf-4085-8825-43e033ddcb23 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:06.504756 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-324b5d00-dcdf-4085-8825-43e033ddcb23 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:06.505574 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-324b5d00-dcdf-4085-8825-43e033ddcb23 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:06.506697 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-324b5d00-dcdf-4085-8825-43e033ddcb23 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:06.576598 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.policy [None req-324b5d00-dcdf-4085-8825-43e033ddcb23 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8d9f649a43450da28c0f7c2e4515ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d34ed67668c475695dbd57530aa6d49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118247) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:35:06.585059 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-324b5d00-dcdf-4085-8825-43e033ddcb23 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 200 len: 1224 microversion: 2.1 time: 0.090807 Aug 01 14:35:06.585636 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 608/1211] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:35:06 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:35:07.606597 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3e294feb-1269-47dc-9a2b-250dcde309e0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:35:07.607342 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-3e294feb-1269-47dc-9a2b-250dcde309e0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: b6731b91-eec1-464e-aa85-217a2a172493] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:35:07.614939 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3e294feb-1269-47dc-9a2b-250dcde309e0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:07.616028 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3e294feb-1269-47dc-9a2b-250dcde309e0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:07.616808 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3e294feb-1269-47dc-9a2b-250dcde309e0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:07.617308 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-3e294feb-1269-47dc-9a2b-250dcde309e0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:07.630709 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-3e294feb-1269-47dc-9a2b-250dcde309e0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] HTTP exception thrown: Instance b6731b91-eec1-464e-aa85-217a2a172493 could not be found. Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3e294feb-1269-47dc-9a2b-250dcde309e0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Request method failure captured: Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 HTTP/1.1 Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-LgBoQm9NvZLFBH-yE_GeuplVaQRb42-Xuimpm2ugydTxw7h7-9QWkFrt7vEpgW7P1Q11ML1sTN2o4o087oYdTKT4FIgIM6LjmAXCLwdVi1zhzM0jum_mcs2fL5KAxNQOM3G5J0vEz6yz_Iq3vUuga923dBcvYDq_OYMBn4-1BdQfI Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: 1d34ed67668c475695dbd57530aa6d49 Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-TestVolumeBootPattern-1973027885 Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:35:07.632437 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:35:07.634237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:35:07.634237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-TestVolumeBootPattern-1973027885 Aug 01 14:35:07.634237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: 1d34ed67668c475695dbd57530aa6d49 Aug 01 14:35:07.634237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-TestVolumeBootPattern-1973027885 Aug 01 14:35:07.634237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-TestVolumeBootPattern-1973027885-project Aug 01 14:35:07.634237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:35:07.634237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:35:07.634237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: cc8d9f649a43450da28c0f7c2e4515ec Aug 01 14:35:07.634237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-TestVolumeBootPattern-1973027885-project Aug 01 14:35:07.634237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:35:07.634237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance b6731b91-eec1-464e-aa85-217a2a172493 could not be found. Aug 01 14:35:07.634237 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': 'b6731b91-eec1-464e-aa85-217a2a172493'} Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6731b91-eec1-464e-aa85-217a2a172493 could not be found. Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:35:07.635238 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6731b91-eec1-464e-aa85-217a2a172493 could not be found. Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6731b91-eec1-464e-aa85-217a2a172493 could not be found. Aug 01 14:35:07.636850 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:35:07.638905 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-3e294feb-1269-47dc-9a2b-250dcde309e0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Returning 404 to user: Instance b6731b91-eec1-464e-aa85-217a2a172493 could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:35:07.638905 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-3e294feb-1269-47dc-9a2b-250dcde309e0 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493" status: 404 len: 111 microversion: 2.1 time: 0.031601 Aug 01 14:35:07.638905 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 604/1212] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:35:07 2022] GET /compute/v2.1/servers/b6731b91-eec1-464e-aa85-217a2a172493 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:35:08.146085 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c75cf135-e69b-4a80-bc59-8dd25f96ef90 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:35:08.146650 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.compute.api [None req-c75cf135-e69b-4a80-bc59-8dd25f96ef90 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118247) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:35:08.153072 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c75cf135-e69b-4a80-bc59-8dd25f96ef90 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:08.153531 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c75cf135-e69b-4a80-bc59-8dd25f96ef90 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:08.154342 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c75cf135-e69b-4a80-bc59-8dd25f96ef90 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:08.154783 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG oslo_concurrency.lockutils [None req-c75cf135-e69b-4a80-bc59-8dd25f96ef90 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118247) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:08.168501 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.wsgi [None req-c75cf135-e69b-4a80-bc59-8dd25f96ef90 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] HTTP exception thrown: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c75cf135-e69b-4a80-bc59-8dd25f96ef90 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Request method failure captured: Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: request: DELETE /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 HTTP/1.1 Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept: application/json Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Accept-Encoding: identity Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Connection: close Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Length: 0 Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Content-Type: application/json Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Host: 10.222.0.49 Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Openstack-System-Scope: None Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: User-Agent: python-urllib3/1.26.10 Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Auth-Token: gAAAAABi5-LgBoQm9NvZLFBH-yE_GeuplVaQRb42-Xuimpm2ugydTxw7h7-9QWkFrt7vEpgW7P1Q11ML1sTN2o4o087oYdTKT4FIgIM6LjmAXCLwdVi1zhzM0jum_mcs2fL5KAxNQOM3G5J0vEz6yz_Iq3vUuga923dBcvYDq_OYMBn4-1BdQfI Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Id: None Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Domain-Name: None Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Identity-Status: Confirmed Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Is-Admin-Project: True Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Id: default Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Domain-Name: Default Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Id: 1d34ed67668c475695dbd57530aa6d49 Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Project-Name: tempest-TestVolumeBootPattern-1973027885 Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Role: reader,member Aug 01 14:35:08.170176 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Roles: reader,member Aug 01 14:35:08.171869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:35:08.171869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant: tempest-TestVolumeBootPattern-1973027885 Aug 01 14:35:08.171869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Id: 1d34ed67668c475695dbd57530aa6d49 Aug 01 14:35:08.171869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-Tenant-Name: tempest-TestVolumeBootPattern-1973027885 Aug 01 14:35:08.171869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User: tempest-TestVolumeBootPattern-1973027885-project Aug 01 14:35:08.171869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Id: default Aug 01 14:35:08.171869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Domain-Name: Default Aug 01 14:35:08.171869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Id: cc8d9f649a43450da28c0f7c2e4515ec Aug 01 14:35:08.171869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: X-User-Name: tempest-TestVolumeBootPattern-1973027885-project Aug 01 14:35:08.171869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: method: > Aug 01 14:35:08.171869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: exception: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. Aug 01 14:35:08.171869 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: action_args: {'id': '6a377af0-0542-410e-93c3-e8c076f16ce6'} Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:35:08.172868 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. Aug 01 14:35:08.174479 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: ERROR nova.api.openstack.wsgi Aug 01 14:35:08.176355 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-c75cf135-e69b-4a80-bc59-8dd25f96ef90 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Returning 404 to user: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. {{(pid=118247) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:35:08.176355 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-c75cf135-e69b-4a80-bc59-8dd25f96ef90 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 404 len: 111 microversion: 2.1 time: 0.029459 Aug 01 14:35:08.176355 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 609/1213] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Aug 1 14:35:08 2022] DELETE /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:35:08.180780 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5d87a790-3321-4019-be2d-6e4b27135bc2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '>' {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:35:08.181425 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.compute.api [None req-5d87a790-3321-4019-be2d-6e4b27135bc2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] [instance: 6a377af0-0542-410e-93c3-e8c076f16ce6] Fetching instance by UUID {{(pid=118246) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:35:08.187388 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5d87a790-3321-4019-be2d-6e4b27135bc2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:08.187841 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5d87a790-3321-4019-be2d-6e4b27135bc2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:08.188608 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5d87a790-3321-4019-be2d-6e4b27135bc2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:35:08.189051 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG oslo_concurrency.lockutils [None req-5d87a790-3321-4019-be2d-6e4b27135bc2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Lock "2f65a740-7946-42c2-9ae7-26876e964053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:35:08.202067 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.wsgi [None req-5d87a790-3321-4019-be2d-6e4b27135bc2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] HTTP exception thrown: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5d87a790-3321-4019-be2d-6e4b27135bc2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Request method failure captured: Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: request: GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 HTTP/1.1 Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept: application/json Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Accept-Encoding: identity Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Connection: close Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Length: 0 Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Content-Type: application/json Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Host: 10.222.0.49 Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Openstack-System-Scope: None Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: User-Agent: python-urllib3/1.26.10 Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Auth-Token: gAAAAABi5-LgBoQm9NvZLFBH-yE_GeuplVaQRb42-Xuimpm2ugydTxw7h7-9QWkFrt7vEpgW7P1Q11ML1sTN2o4o087oYdTKT4FIgIM6LjmAXCLwdVi1zhzM0jum_mcs2fL5KAxNQOM3G5J0vEz6yz_Iq3vUuga923dBcvYDq_OYMBn4-1BdQfI Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Id: None Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Domain-Name: None Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Identity-Status: Confirmed Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Is-Admin-Project: True Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Id: default Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Domain-Name: Default Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Id: 1d34ed67668c475695dbd57530aa6d49 Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Project-Name: tempest-TestVolumeBootPattern-1973027885 Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Role: reader,member Aug 01 14:35:08.203560 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Roles: reader,member Aug 01 14:35:08.205600 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d34ed67668c475695dbd57530aa6d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}] Aug 01 14:35:08.205600 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant: tempest-TestVolumeBootPattern-1973027885 Aug 01 14:35:08.205600 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Id: 1d34ed67668c475695dbd57530aa6d49 Aug 01 14:35:08.205600 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-Tenant-Name: tempest-TestVolumeBootPattern-1973027885 Aug 01 14:35:08.205600 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User: tempest-TestVolumeBootPattern-1973027885-project Aug 01 14:35:08.205600 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Id: default Aug 01 14:35:08.205600 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Domain-Name: Default Aug 01 14:35:08.205600 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Id: cc8d9f649a43450da28c0f7c2e4515ec Aug 01 14:35:08.205600 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: X-User-Name: tempest-TestVolumeBootPattern-1973027885-project Aug 01 14:35:08.205600 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: method: > Aug 01 14:35:08.205600 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: exception: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. Aug 01 14:35:08.205600 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: action_args: {'id': '6a377af0-0542-410e-93c3-e8c076f16ce6'} Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: {{(pid=118246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:35:08.207001 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. Aug 01 14:35:08.209664 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: ERROR nova.api.openstack.wsgi Aug 01 14:35:08.211613 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: DEBUG nova.api.openstack.wsgi [None req-5d87a790-3321-4019-be2d-6e4b27135bc2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Returning 404 to user: Instance 6a377af0-0542-410e-93c3-e8c076f16ce6 could not be found. {{(pid=118246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:35:08.211613 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO nova.api.openstack.requestlog [None req-5d87a790-3321-4019-be2d-6e4b27135bc2 tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6" status: 404 len: 111 microversion: 2.1 time: 0.028540 Aug 01 14:35:08.211613 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: [pid: 118246|app: 0|req: 605/1214] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Aug 1 14:35:08 2022] GET /compute/v2.1/servers/6a377af0-0542-410e-93c3-e8c076f16ce6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:35:09.723111 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: DEBUG nova.api.openstack.wsgi [None req-d9e82e5f-bd01-4ea3-8964-0d8a68a992ac tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] Calling method '.version_select at 0x7fb2541ce0d0>' {{(pid=118247) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:35:09.822763 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO nova.api.openstack.requestlog [None req-d9e82e5f-bd01-4ea3-8964-0d8a68a992ac tempest-TestVolumeBootPattern-1973027885 tempest-TestVolumeBootPattern-1973027885-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-544331128" status: 202 len: 0 microversion: 2.1 time: 0.103486 Aug 01 14:35:09.823351 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: [pid: 118247|app: 0|req: 610/1215] 10.222.0.49 () {58 vars in 1260 bytes} [Mon Aug 1 14:35:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-544331128 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:35:40.786772 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:35:40.787427 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Mon Aug 1 14:35:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:35:41.026423 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:35:41.026946 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Mon Aug 1 14:35:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:35:49.855263 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:35:49.855890 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Mon Aug 1 14:35:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:38:06.119275 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:38:06.119924 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Mon Aug 1 14:38:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:39:00.797087 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:39:00.797737 dv-cinder-787296-13-iscsi devstack@n-api.service[118247]: Mon Aug 1 14:39:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:39:01.035644 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:39:01.036337 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Mon Aug 1 14:39:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:39:09.865127 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:39:09.865726 dv-cinder-787296-13-iscsi devstack@n-api.service[118246]: Mon Aug 1 14:39:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!